AD- A 142  503 


UNCLASSIFIED 


IDA/OSD( INSTITUTE  FOR  DEFENSE  ANALYSES/OFFICE  OF  THE 
SECRETARY  OF  DEFENSE.. (U)  INSTITUTE  FOR  DEFENSE 
ANALYSES  ALEXANDRIA  VA  JR  RIVOIRE  ET  AL .  NOV  83 
IDA-R-272-VOL-2  IDA/HQ-83-25966  F/G  15/3 


NL 


/?>/)  /fy.  S2>3 


Copy  3  0  ol  200  copies 


IDA  REPORT  R-272 


IDA/OSD  RELIABILITY  AND 
MAINTAINABILITY  STUDY 

Volume  II:  Core  Group  Report 


John  R.  Rivoire 
IDA  R&M  Study  Director 

Paul  F.  Goree 
IDA  Deputy  Study  Director 

Hylan  B.  Lyon,  Jr. 
Technology  Director 

Richard  A.  Gunkei 
A  nalysis  Director 


November  1983 


Prepared  for 

Office  of  the  Under  Secretary  of  Defense  for  Research  and  Engineering 

and 

Office  of  the  Assistant  Secretary  of  Defense 
(Manpower,  Reserve  Affairs  and  Logistics) 


( 

INSTITUTE  FOR  DEFENSE  ANALYSES 


84  '.’6  ^  00'f 


IDA  Log  No  HQ  83-?596B 


UNCLASSIFIED 


SECURITY  CLASSIFICATION  OF  THIS  RAGE  (Whtt  Pit  Enfr»d) 


|  REPORT  DOCUMENTATION  PAGE 

READ  INSTRUCTIONS 

BEFORE  COMPLETING  FORM 

1.  REPORT  HUMBER 

2.  GOVT  ACCESSION  NO. 

Apt)  50? 

3.  RECIPIENT’S  CATALOG  NUMBER 

1  4.  TITLE  (and  Subll(H) 

IDA/OSD  Reliability  and  Maintainability  Study 

Vol.  II:  Core  Group  Report 

S  TYPE  OF  REPORT  A  PERIOD  COVERED 

FINAL 

July  1982  -  August  1983 

S.  PERFORMING  ORG.  REPORT  NUMBER 

IDA  Report  R-272,  Vol.  II 

7.  authors  John  R>  Ri voire,  IDA  R&M  Study  Director, 
Paul  F.  Goree,  IDA  Deputy  Study  Director,  Hylan  E 
Lyon,  Jr.,  Technology  Director,  Richard  A. 

Cimkol t  analysis  Director  .  . ... 

%.  CONTRACT  OR  GRANT  NUMBER^ 

MDA  903  79  C  0018 

9.  PERFORMING  ORGANIZATION  name  ano  aooress 

Institute  for  Defense  Analyses 

1801  N.  Beauregard  Street 

Alexandria,  VA  22311 

10.  PROGRAM  ELEMENT.  PROJECT.  TASK 

AREA  A  WORK  UNIT  NUMBERS 

Task  T- 2-126 

11.  CONTROLLING  OFFICE  NAME  ANO  ADDRESS 

Office  of  the  Assistant  Secretary  of  Defense 

12.  REPORT  DATE 

November  1983 

1  (MRA&L) ,  The  Pentagon 

1  Washincrton.  D.C.  20301 

1  3-  NUMBER  OF  PAGES 

102 

f«.  MONITORING  AGENCY  NAME  a  AOORESS(tf  dlffmtmnt  from  Controlling  Otflcm) 

DoD-IDA  tfeinagement  Office 

1801  N.  Beauregard  Street 

»5.  SECURITY  CLASS,  (of  t him  rmport) 

UNCLASSIFIED 

|  Alexandria,  VA  2 2 ill 

IS.I  declassification/ DOWN  GRADING 
SCHEDULE 

IB.  DISTRIBUTION  STATEMENT  (of  tftl m  Rmport) 

Approved  for  public  release?  distribution  unlimited. 

!7.  DISTRIBUTION  STATEMENT  (of  fh*  mbmtfct  mntmrmd  In  Block  20,  If  dlftmrmnt  from  Rmport) 

None 

IB.  SUPPLEMENTARY  NOTES 

N/A 

1  is.  KEY  WOROS  (Conttnum  on  rmrormm  old*  II  nmcmmmmry  and  Idmntlty  by  block  numbmr) 

R&M  Study,  Radar  Case  Studies,  Technology  Studies,  R&M  Pequiranents,  Logistics 
Data  Systems,  Diagnostics,  R&M  Growth  and  Maturation. 

20.  ABSTRACT  fConlfmi*  an  nmtm  mldm  It  nmcPimr  Idmntlfy  by  block  mmtbmr) 

This  report  is  in  four  volumes:  Vol.  I,  Executive  Summary;  Vol.  II,  Core 

Group  Report;  Vol.  Ill,  Case  Studies  Analysis  and  Vol.  IV,  Technology  Steering 
Group  Report.  Study  results  were  derived  from  case  studies  performed  on  eight 
existing  weapon  systems  and  from  working  groups  that  examined  sixteen  indivi¬ 
dual  technology  areas.  Specific  R&M  reccrrmendations  are  made  in  the  following 
eight  areas:  Technology  Base  R&M  Programs;  R&M  Demonstration  Programs;  FSED 
Planning  and  Analysis;  R&M  Standards;  FSED  Management  Awareness  of  R&M;  (contd 

DO  ,  ,22*7*  1473  tWTION  OF  »  NOV  »»  IS  OBSOLETE 

UNCLASSIFIED 

SECURITY  CLASSIFICATION  OF  THIS  RAGE  (Wh*n  D.f.  Bnfrtd) 


IDA  REPORT  R-272 


IDA/OSD  RELIABILITY  AND 
MAINTAINABILITY  STUDY 

Volume  II:  Core  Group  Report 


John  R.  Rivoire 
IDA  R&M  Study  Director 

Paul  F.  Goree 
IDA  Deputy  Study  Director 

Hylan  B.  Lyon,  Jr. 

Technology  Director 

Richard  A.  Gunkel 
A  na  lysis  Director  J  a  - 


November  1983 


I  DA 


INSTITUTE  FOR  DEFENSE  ANALYSES 
1801  North  Beauregard  Street 
Alexandria,  Virginia  223 1 1 


Contract  MDA  903  79  C  0018 
Task  T-2-126 


ACKNOWLEDGMENTS 


The  Study  Director  and  his  Executive  Council  would 
like  to  thank  the  many  individuals  who  have  made 
such  an  important  contribution  to  the  preparation 
of  this  document.  First,  thanks  to  Paul  F.  Goree , 
who  in  addition  to  his  activities  as  Study  Deputy 
Director,  also  provided  outstanding  leadership  as 
Case  Study  Director,  to  Dr.  Hylan  B.  Lyon,  Jr.  for 
his  activities  as  Technology  Director,  to  Richard  A. 
Gunkel  for  his  activities  as  Analysis  Director  and 
to  Dr.  Robert  H.  Fox,  Director,  Science  and  Tech¬ 
nology  Division  at  the  Institute  for  Defense  Analy¬ 
ses,  for  his  valuable  counsel  and  support. 

Secondly,  special  thanks  to  Anthea  M.  DeVaughan, 
Ruth  B.  Kumbar,  Donna  L.  Ryan,  Mary  Lou  Caldwell, 
Janet  Y.  Jones-Brooks ,  Yvonne  Carrington,  and  all 
the  others  that  so  unselfishly  dedicated  so  many 
hours  to  meeting  arrangements,  typing,  page  make-up 
and  all  those  other  thankless  tasks  that  are  so 
vital  to  the  final  product.  We  could  not  have  made 
it  without  them. 

We  would  be  remiss  if  we  did  not  give  special  thanks 
to  the  hundreds  of  companies  across  the  country  and 
to  all  the  Military  Services  for  their  support  and 
numerous  contributions  to  the  study. 

And  finally,  thanks  to  our  editor,  Richard  Cheney, 
and  his  staff  for  their  publication  assistance  and 
Robert  German  and  his  staff  for  their  tireless  ef¬ 
forts  in  supporting  the  many  expedited  reproduction 
requests  required  for  meetings  and  associated  study 
activities. 


John  R.  Rivoire 
Director 


820/5-1 


CONTENTS 


Acknowledgments  iii 

Abbreviations  vii 

I.  Synopsis  1-1 

A.  Background  1-1 

B.  Objective  and  Approach  1-2 

C.  Report  Organization  1-5 

D.  Results  1-5 

II.  Overall  Findings  and  Recommendations  II-l 


A.  Structure  II-l 

B.  Technology  Base  Structuring  II-l 

C.  Program  Planning  and  Analysis  II-4 

D.  Specific  Areas  of  Concern  11-10 

III.  Conclusions  from  the  Technology  Steering  Group  III-l 

Report 


A.  Establishment  of  R&M  Technology  Base  Demon-  III-l 

stration  Programs 

B.  Interdependencies  III-6 

C.  The  Discipline  and  Structure  of  R&M  Management  III-7 

D.  Basic  Research  Thrusts  III-8 

1.  Composites  III-8 

2.  Manpower  III-10 

3.  Corrosion  III-10 

4.  Predictive  Techniques  III-10 

5.  Diagnostics  III-ll 

6.  Architecture  for  Reliability  III-ll 


IV.  Conclusions  from  the  Case  Study  Analysis 


IV-1 


A.  High  Payoff  Actions  in  the  Acquisition  Process  IV-1 

1.  Structure  to  Manage  Interdependent  Program  IV-1 
Elements 

2.  Reliability  Design  Tools  and  Processes  IV-2 

3.  "Off-line"  Maturing  of  Subsystems  and  IV-6 

Components 

4.  R&M  Growth  and  Maturation  IV-7 

5.  Diagnostics  IV-1 5 


8  20/5-2 


v 


B. 

Info  rmat ion 

IV-23 

1.  Conclusion 

IV-23 

2.  Observations 

IV-23 

3.  Findings 

IV-24 

4.  Action 

IV-25 

C. 

Educat ion 

IV-26 

1.  Conclusion 

IV-26 

2.  Observations 

IV-26 

3.  Findings 

IV-26 

Appendix  A--Task  Order 

A-l 

Appendix  B--Study  Process  Overview 

B-l 

Appendix  C--Draft  Army  Action  Plan 

C-l 

820/5-3 


vi 


ABBREVIATIONS 


A3 

A/C 

AFB 

AFIT 

ALCM 

ALMC 

AMS 

ATE 

ATF 

ATPG 

BCS 

BIT 

CAD 

CAM 

CND 

DARCOM 

DoD 

DSARC 

DSB 

DSMC 

EC  P 
ESS 

FDIC 

FIT 

FMEA 

FOT&E 

FREO 

FSD 

FSED 

HARDMAN 

HR 

IC 

ICNIA 

IDA 

IOC 

IR&D 

ITC 


Affordable  Acquisition  Approach 

Aircraf  t 

Air  Force  Base 

Air  Force  Institute  of  Technology 
Air-Launched  Cruise  Missile 
Army  Logistics  Management  Center 
Airborne  Maintenance  System 
Automated  Test  Equipment 
Advanced  Tactical  Fighter 
Automatic  Test  Program  Generation 

Bench-Checked  Serviceable 
Built-in-Test 

Computer-Aided  Design 
Computer-Aided  Manufacture 
Cannot  Duplicate 

U.  S.  Army  Materiel  Development  and 
Readiness  Command 
Department  of  Defense 

Defense  Systems  Acquisition  Review  Council 

Defense  Science  Board 

Defense  Systems  Management  College 

Engineering  Change  Proposal 
Environmental  Stress  Screening 

Fault  Detect ion/Isolation  Code 
Fault  Isolation  Test 
Failure  Mode  and  Effects  Analysis 
Follow-on  Test  and  Evaluation 
Frequency 

Full-Scale  Development 
Full-Scale  Engineering  Development 

Hardware-Manpower  Trade-Off 
Hour 

Integrated  Circuit 

Integrated  Commun ications/Naviga t ion/ 
Identification  Architecture 
Institute  for  Defense  Analyses 
Initial  Operating  Capability 
Independent  Research  and  Development 
Intern  Training  Center 


vi  i 


131/6-3 


I 


SYNOPSIS 


A.  BACKGROUND 

In  recent  years  there  has  been  a  rising  concern  about  DoD's 
ability  to  keep  weapon  systems  both  modern  and  combat-ready. 

At  any  given  time  the  availability  of  many  of  these  systems  has 
been  below  that  needed  to  maintain  the  required  force  posture. 
The  seriousness  of  this  problem  was  highlighted  in  the  report 
of  the  1981  Defense  Science  Board  (DSB)  study  of  the  Operational 
Readiness  of  High  Performance  Systems.  One  of  the  major  recom¬ 
mendations  of  that  study  was  to  design  reliability  into  the  sys¬ 
tems  from  the  start  and  mature  that  capability  prior  to  full- 
rate  production.  The  1981  DSB  study  also  highlighted  problems 
with  diagnostics  and  recognized  that  increasing  system  complex¬ 
ity,  while  not  incompatible  with  readiness,  made  it  imperative 
that  the  Department  of  Defense  (DoD)  demand  and  manage  acquisi¬ 
tion  to  achieve  readiness  requirements. 

Because  of  the  well  publicized  problems  in  reliability, 
readiness  and  support,  DoD  put  improvements  in  this  area  high 
on  its  priority  list.  The  Carlucci  initiatives  directed  at 
reforming  the  acquisition  process  gave  reliability  and  support 
considerations  a  very  high  priority.  As  a  result  there  has  been 
a  major  increase  in  DSARC  and  top  management  attention.  On  each 
major  program  there  is  visibility  at  the  top  on  progress  in 
meeting  R&M  objectives  through  development,  production  and  in 
early  field  experience. 

The  track  record  from  these  efforts  is  uneven.  Many  of  the 
more  mature  technologies  have  done  relatively  well  in  meeting 
reliability  objectives.  Newer,  fast  developing  technologies 
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often  have  serious  problems,  however,  as  do  programs  with 
accelerated  or  compressed  schedules.  The  latter  are  becoming 
more  frequent  due  to  the  Administration  objectives  of  fielding 
new  hardware  faster.  Thus,  there  is  a  major  challenge  in 
learning  to  manage  acquisitions  on  accelerated  programs  so  as 
to  attain  desirable  R&M  objectives.  Technology  advances  are 
potentially  helpful  in  such  areas  (e.g.,  in  electronics)  by 
providing  opportunities  to  improve  both  performance  and  R&M, 
provided  the  problem  is  attacked  in  both  the  technology  base 
and  the  acquisition  process. 

In  the  future,  increasing  weapon  system  complexity  and 
rising  maintenance  costs  will  lead  to  demands  for  higher  levels 
of  R&M.  A  review  of  the  Services'  Year  2000  studies  identified 
a  common  theme  calling  for  more  flexibility,  more  autonomy, 
more  dispersal,  and  reduced  support  tail  dependency  in  combat 
forces.  While  the  validity  of  the  presumptions  on  which  these 
requirements  are  based  may  be  challenged,  their  general  thrust 
is  unmistakable. 

As  a  result  of  these  concerns,  the  Office  of  the  Assistant 
Secretary  of  Defense  (Manpower,  Reserve  Affairs  and  Logistics) 
and  the  Office  of  the  Under  Secretary  of  Defense  for  Research 
and  Engineering  initiated  this  study,  "Steps  Toward  Improving 
the  Materiel  Readiness  Posture  of  the  DoD”  (short  title:  R&M 
Study)  at  the  Institute  for  Defense  Analyses  (IDA)  with  the 
purpose  of  identifying  and  providing  support  for  high-payoff 
actions  which  the  DoD  can  take  to  improve  system  design,  devel¬ 
opment  and  support  processes  so  as  to  provide  quantum  improve¬ 
ments  in  Rv'M  and  readiness  through  innovative  uses  of  advancing 
technology  and  program  structure  (Appendix  A,  Task  Order). 

B.  OBJECTIVE  AND  APPROACH 

The  objective  of  this  study  was  to  analyze  the  state  of 
current  and  emerging  R&M  from  two  different  standpoints:  first, 


1-2 


820/1-2 


by  looking  at  specific  new  technologies  for  their  potential  con¬ 
tribution  to  R&M  improvement  and  for  the  type  of  problems  antic¬ 
ipated  in  their  application;  and  second,  by  examining  specific 
weapons  system  acquisition  programs  to  assess  the  impact  of 
their  program  structures  on  the  achievement  of  desired  R&M  goals. 
After  consultation  with  the  Services  and  industry  groups,  and 
examination  of  pertinent  reference  documentation,  sixteen  tech¬ 
nology  areas  were  selected  for  study  as  follows: 

Detailed  Results  in 

_ Technology  Studied _  IDA  Record  Document 

•  Artificial  Intelligence  D-28 

•  Cabling  and  Connectors  D-29 

•  CAD/CAM  D-30 

•  Structural  Composites  D-31 

•  Directed  Energy  D-32 

•  Fiber  Optics  D-33 

•  Integrated  Systems  of  Manufacture  D-34 

•  Manpower,  Personnel  and  Training  D-35 

•  Mechanical  Systems  Condition  D-36 

Moni tori ng 

•  Nondestructive  Evaluation  D-37 

•  Operational  Software  D-38 

•  Electronic  Packaging  and  D-39 

Interconnection 

•  Power  Supplies  D-40 

•  Testing  Technology  D-41 

•  Very-High  Speed  Integrated  Circuits  (VHSIC)  D-42 

•  Diagnostics 

Eight  relatively  successful  programs  were  selected  for  detailed 
study  to  address  the  issue  of  program  structure.  The  eight 
programs  selected  were  as  follows: 
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_ Program  Studied _ 

•  APG-63  Radar  (F-15) 

•  APG-65  Radar  (F/A-18) 

•  APG-66  Radar  (F-16 ) 

•  T70 0  Engine  (BLACKHAWK) 

•  ASN-128  Lightweight  Doppler 
tion  Radar  (LDNS) 

•  TPQ-36  Radar  (FIREFINDER) 

•  TPO-37  Radar  (FIREFINDER) 

•  SPY-l-A  Radar  (AEGIS) 


Detailed  Results  in 
IDA  Record  Document 


D-19 
D-2  0 
D-2  1 
D-2  2 

Naviga-  D-23 

D-2  4 
D-2  4 


In  addition,  many  other  programs  and  associated  reports  were  re¬ 
viewed  for  specific  relevant  information. 

Working  groups  composed  of  Service  and  industry  personnel 
were  then  formed  for  each  of  the  technology  areas  and  programs 
to  be  studied.  Working  group  activities  were  coordinated  and 
overseen  by  an  Executive  Council  Core  Group  made  up  of  repre¬ 
sentatives  from  DoD  and  industry.  All  the  Services,  the  Office 
of  the  Secretary  of  Defense  (OSD),  universities,  and  over  100 
contractors  participated  in  and  contributed  to  the  study  (see 
Appendix  B  for  membership  in  the  Core  Group  and  the  numerous 
working  groups).  More  than  300  separate  meetings  were  held, 
encompassing  technology  and  case  study  working  groups,  as  well 
as  conferences  with  senior  military  officers,  government  and 
industrial  executives.  The  findings  and  recommendations  report¬ 
ed  represent  a  synthesis  of  the  quantitative  and  qualitative 
analyses  these  groups  performed  and  the  judgments  they  applied 
to  the  results. 
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C.  REPORT  ORGANIZATION 


The  results  of  the  study  are  documented  in  the  hierarchy 
of  reports  shown  in  Fig.  1. 

This  volume,  the  Core  Group  Report,  is  a  condensed  summary 
of  the  conclusions  reached  in  the  Technology  Steering  Group  Re¬ 
port  (Vol.  IV)  and  the  Case  Study  Analysis  (Vol.  III).  In  the 
following  sections  of  this  volume  the  overall  findings  and  rec¬ 
ommendations  are  presented  in  Section  II,  and  the  conclusions 
from  which  they  are  drawn  are  presented  in  Sections  III  and  IV. 
Section  III  is  a  summary  of  conclusions  from  the  Technology 
Steering  Group  Report,  and  Section  IV  is  a  similar  summary  from 
the  Case  Study  Analysis. 

D.  RESULTS 

Ten  specific  R&M  recommendations  in  the  following  three 
categories  are  presented  in  the  next  section  of  this  report: 

A.  Technology  Base  Structuring 

1.  Technology  Base  R&M  Programs 

2.  R&M  Demons trat ion  Programs 

B.  Program  Planning  and  Analysis 

3.  Program  Planning  and  Analysis  to  Integrate  Inter¬ 
dependent  Elements 

4.  Recent  Developments  in  Program  Structuring 

5.  R&M  Standards 

6.  Management  Incentives 

7.  New  System  Maturation 

C.  Areas  of  Special  Concern 

8.  Collection  and  Use  of  Field  R&M  Data 

9.  R&M  Training  for  Managers 

10.  Diagnostics. 
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These  recommendations  offer  fresh  opportunit ies  for  the  appli¬ 
cation  of  technology  and  management  initiatives  in  new  areas  as 
well  as  in  areas  already  well  established.  As  a  result  of  the 
large-scale  participation  by  both  industry  and  the  Services, 
various  actions  have  already  been  initiated  to  use  information 
developed  during  the  course  of  the  work  described  above.  Within 
the  Navy  and  the  Air  Force,  actions  thus  far  are  primarily  pro¬ 
gram-level  applications.  The  Army,  however,  has  initiated, 
through  the  Materiel  Development  and  Readiness  Command  (DARCOM) 
Headquarters,  an  action  plan  that  defines  tasks  to  be  performed 
and  assigns  organizational  responsibility  for  implementing  some 
of  the  findings  of  this  study  (Volume  II,  Appendix  C). 

In  addition  it  should  be  noted  that,  independent  of  this 
study,  the  Office  of  the  Secretary  of  Defense  (OSD)  has  estab¬ 
lished  a  Logistics  Research  and  Development  (R&D)  Policy  Council 
charged  with  giving  increased  emphasis  to  R&D  in  support  of 
logistics  needs.  The  policy  decisions  of  this  group  are  being 
implemented  by  a  Logistics  R&D  Working  Group  consisting  of  OSD 
and  Service  representat i ves  from  both  the  logistics  and  the  R&D 
communities.  Some  of  the  recommendations  of  this  study  relate 
to  these  new  groups. 
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II 


OVERALL  FINDINGS  AND  RECOMMENDATIONS 


A.  STRUCTURE 

These  findings  and  recommendations  integrate  results  of 
analysis  across  the  disparate  fifteen  technology  reports,  seven 
case  studies,  and  specific  information  from  many  other  programs 
and  associated  reports,  as  detailed  in  Vols.  Ill  and  IV.  For 
convenience,  these  findings  and  recommendations  are  grouped 
into  the  three  categories  of  Technology  Base  Structuring,  Program 
Planning  and  Analysis,  and  Areas  of  Special  Concern. 

B.  TECHNOLOGY  BASE*  STRUCTURING 

FINDING  1:  TECHNOLOGY  BASE  R&M  PROGRAMS 


Selective  expansion  of  technology  base  programs  directed 
to  improve  reliability  and  maintainability  of  components,  sub¬ 
systems  and  systems  is  needed  for  current  and  future  military 
systems. 


Comments  : 

Areas  have  been  identified  where  additional  technology  ef¬ 
forts  and/or  coordination  of  existing  efforts  could  improve  the 
design  data  base  and  associated  design  alternative  selections 
available  to  improve  the  reliability,  maintainability,  and/or 


*The  "technology  base"  consists  of  R&D  programs  that  are  not 
associated  with  a  system  that  is  in  or  past  full-scale  engi¬ 
neering  development.  In  general,  these  are  funded  in  the  6.1, 
6.2  and  6.3A  areas,  but  exceptions  occur. 
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readiness  of  current  or  future  systems.  Identified  areas  are: 
Composites,  Corrosion,  Predictive  Techniques,  Diagnostics,  and 
Architecture  for  Reliability  (Vol.  II,  Section  III;  Vol.  IV, 
Section  V).  The  combination  of  the  expanding  use  of  complex 
electronic  and  mechanical  devices  with  embedded  computer  systems 
places  greater  importance  on  the  accuracy  and  fault-free  opera¬ 
tion  required  from  diagnostics  systems  such  as  built-in  test  and 
fault-isolation  test  (BIT/FIT).  This  expanding  need,  coupled 
with  the  poor  performance  of  current  diagnostics  systems,  sug¬ 
gests  that  an  immediate  and  intensive  effort  is  required  to  re¬ 
solve  this  problem  (Vol.  II,  Section  III-D;  Vol.  Ill,  Section  IV). 

Recommendation : 

The  Logistics  R&D  Working  Group  under  the  direction  of  the 
Policy  Council  is  assembling  individual  Service  plans  and  an 
integrated  DoD  plan  for  "Log  R&D."  It  is  recommended  that  the 
Technology  Working  Group  Reports  (listed  on  page  1-3)  be  reviewed 
by  appropriate  Service  agencies  and  laboratories  as  an  input 
to  the  formulation  of  Service  plans. 

FINDING  2;  R&M  DEMONSTRATION  PROGRAMS 

There  is  a  need  to  establish  a  set  of  R&M  objectives  sup¬ 
ported  by  applied  technology  demonstration  programs  as  an  inte¬ 
gral  part  of  achieving  advanced  performance  objectives.  Such 
demonstration  program  plans  should  include  "road  maps"  which 
relate  the  timing  of  technology  developments  to  their  use  in 
the  demonstration  program.  Management  must  also  establish  re¬ 
view  procedures  to  ensure  timely  transition  of  support  tech¬ 
nology  into  weapon  systems  and  support  systems. 

Comments : 

There  are  insufficient  demonstration  programs  in  the  tech¬ 
nology  base  aimed  directly  at  R&M  objectives  or  which  include 
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R&M  advances  along  with  performance  advances.  Most  such  pro¬ 
grams  are  directed  primarily  at  demonstrating  improved  perform¬ 
ance  capabilities  of  components  or  subsystems  even  though  the 
potential  for  significant  R&M  advances  is  known  and  advertized 
(as  in  the  case  of  VHSIC).  In  addition,  technical  analysis  to 
determine  underlying  causes  of  failures  is  sorely  needed  to 
guide  technology  base  development.  Technical  analyses  should 
be  conducted  by  appropriate  laboratories  and  technology  devel¬ 
opments  identified,  "road  maps"  (for  funding  and  scheduling) 
developed  and  prioritized,  and  target  systems  for  demonstrations 
identified.  This  will  provide  for  a  more  rapid  adaptation/ 
infusion  of  new  technology  whereby  the  technology  can  be  matured 
off-line  and  proven  acceptable  for  engineering  use  separately 
from  specific  engineering  development  programs  (Vol.  II,  Section 
III-A,  B,  and  C;  Vol.  IV,  Section  V). 

Recommendation : 

The  Services  should  establish,  with  concurrence  of  the  Lo¬ 
gistics  R&D  Policy  Council,  a  set  of  quantitative,  user-approved 
R&M  Objectives,  which  in  turn  can  be  used  to  structure  quanti¬ 
tative  design  objectives  for  advanced  technology  subsystems  and 
components.  The  Services  should  then  prepare,  and  include  in 
their  plans  given  to  the  Logistics  R&D  Working  Group,  a  coordi¬ 
nated  program  of  demonstrations,  based  on  technology  availability 
to  reach  these  objectives.  A  set  of  time-based  "road  maps"  to 
connect  technology  availability  to  end-use  demonstrations  should 
be  constructed. 

DoD  and  Service  acquisition  responsibilities  and  procedures 
should  be  established  to  ensure  that  a  structured  review  of  sup¬ 
port  technology  is  made  at  the  time  of  acquisition  strategy  formu 
lation  for  each  new  system  in  order  to  determine  what  support 
technology  is  ready  for  transition. 
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C.  PROGRAM  PLANNING  AND  ANALYSIS 

FINDING  3:  PROGRAM  PLANNING  AND  ANALYSIS  TO  INTEGRATE  INTER¬ 
DEPENDENT  ELEMENTS 

Formalized  program  planning  and  analysis  procedures  are 
needed  early  in  the  acquisition  process  in  order  to  reduce  R&M/ 
readiness  risk  and  to  ensure  halanced  considerations  of  perform¬ 
ance,  supportability ,  budget,  and  schedule. 

Comments : 

Year  after  year  studies  are  performed  to  ascertain  why 
programs  fail  or  succeed  in  providing  reliable  and  maintainable 
systems.  However,  surprisingly  little  is  known  quantitatively 
about  the  interdependencies  of  program  activities  which  affect 
R&M  results.  In  particular,  management-level  decisions  on 
funding  and  schedule  adjustments  to  programs  as  a  whole  appear 
to  be  made  without  awareness  of  R&M  consequences.  For  example, 
the  relationships  between  front-end  funding  profiles  and  the 
ability  to  carry  out  requisite  R&M  design,  analysis,  component 
development,  and  R&M  growth  tests  are  not  often  addressed  in 
the  critical  early  planning  phases.  To  develop  such  a  discipline 
approaches  to  program  structure  analysis  must  be  pursued  with 
vigo  r . 

The  need  to  emphasize  R&M  requirements  starting  with  mile¬ 
stone  zero  and  proceeding  into  the  Full-Scale  Engineering 
Devel opment/Product ion  process  is  spelled  out  in  DoD  directives 
(e.g.,  5000.40  and  5000.39),  and  R&M  Program  Plans  and  their 
various  elements  are  defined  in  MIL  STDs  785  and  470,  respec¬ 
tively.  It  is  apparent  from  this  and  other  studies,  however, 
that  implementation  of  the  directives  and  the  R&M  Program  Plans 
varies  among  different  types  of  equipment  and  different  weapon 
system  programs. 
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There  is  little  doubt  that  systems  with  higher  reliability 
are  achievable,  but  the  overriding  issue  is  the  ability  to  hold 
together  all  key  programmatic  aspects  of  the  structure  when 
faced  with  the  conflicting  demands  of  funding,  schedule,  system, 
and  political  constraints.  While  the  R&M  elements  of  the  acqui¬ 
sition  process  are  generally  well-known,  the  interrelationships 
and  dependencies  of  elements  and  subelements  are  not  so  well 
understood.  As  a  consequence,  we  find  cases  where  management 
has  traded  R&M  elements  for  apparent  cost  reductions  and/or  im¬ 
proved  schedules,  but  which  ultimately  has  led  to  overruns,  de¬ 
lays,  and  costly  downstream  logistics  problems. 

The  management  and  engineering  challenge  is  to  structure  an 
acceptable  disciplined  approach  to  planning  programs  to  ensure 
balanced  considerations  of  performance,  budget,  schedule,  and 
supportabi 1 i ty ;  and  to  ensure  that  the  appropriate  balance  is 
not  lost  as  the  program  progresses  through  its  various  phases. 

The  elements  of  a  discipline  for  planning  and  analyzing 
R&M  attributes  of  program  structuring  were  identified  during 
this  study.  The  discipline  encompasses  considerations  for  vari¬ 
ations  in  programs  and  their  acquisition  environment,  how  they 
are  structured  for  R&M,  the  interrelationships  and  dependencies 
of  program  elements,  concurrency  and  scheduling.  It  provides 
the  visibility  to  understand  reliability,  maintainability,  and 
readiness  implications  of  program  structuring  (Vol.  II,  Section 
IV-A.l;  Vol.  Ill,  Section  IV). 

Recommendat ion : 

DoD  should  issue  a  "Guide  to  Structuring  a  Weapon  System 
Program  for  R&M,"  developed  by  the  Services  and  endorsed  by  the 
Joint  Logistic  Commanders,  which  includes: 

•  Emphasis  on  early  incorporation  of  R&M  requirements  into 
engineering  design  based  on  specific  program  structure 
techniques  such  as  are  recommended  in  this  study  (Vol. 
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Ill,  Appendix  R)  coupled  with  techniques  such  as  the 
Navy  is  developing,  and  including  means  for  validation 
testing  during  development  and  a  formal  maturation  phase 
for  production  units. 

•  Establishment  of  a  funding  profile  at  the  outset  of  the 
development  phase  that  supports  the  development,  growth, 
and  maturing  of  R&M  elements  in  the  program  structure 
through  FS ED  and  early  production.  Priorities  should  be 
placed  on  analysis  to  improve  present  planning  factors 
and  estimates  for  the  cost  of  R&M  activities. 

•  Firmly  established  audit  procedures  to  ensure  that  DoD 
directives  and  R&M  program  requirements  are  being  fol¬ 
lowed  in  a  consistent  and  effective  manner. 

FINDING  4:  RECENT  DEVELOPMENTS  IN  PROGRAM  STRUCTURING 


Whereas  the  critical  elements  of  a  reliability  by  design 
approach  have  come  to  be  known  and  widely  accepted,  two  ele- 
ments— computer-a  ided  design  engineering  and  manufacturing  (CAD/ 
CAM)  and  environmental  stress  screening  (ESS)--are  rapidly  de¬ 
veloping  and  deserve  special  attention. 

Comment : 

Rapid  evolvement  of  computer-a ided  design  engineering  and 
manufacturing  offer  a  major  opportunity  to  analyze  more  com¬ 
pletely  the  R&M  features  of  the  design  prior  to  commitment  to 
hardware.  To  achieve  this  potential  requires  a  strong  commit¬ 
ment  to  develop  the  needed  data  bases  and  to  integrate  compre¬ 
hensive  analysis  capabilities  into  CAD/CAM  systems.  Industry 
progress  and  intentions  in  this  area  are  mixed. 

Environmental  stress  screening  has  gone  through  rapid 
evolution.  A  wide  variety  of  approaches  are  being  prac.t  iced 
which  differ  substantially  in  intensity,  cost  and  payoff.  (Vol. 
II,  Section  IV-A.2;  Vol.  Ill,  Section  IV). 
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Recommendat ion : 


OSD  and  the  Services  should  sponsor  a  task  on  computer- 
aided  design  and  engineering  for  R&M  in  order  to  establish  the 
criteria,  a  requirements  approach  and  the  funding  needed  to 
rapidly  achieve  the  potential  R&M  improvements  through  design 
and  design  analysis. 

A  policy  should  be  established  that  ESS  must  be  applied  to 
all  acquisitions.  DoD  should  fund  sufficient  promising  ESS 
approaches  to  define  a  consistent  set  of  ground  rules  for  spe¬ 
cifying  requirements  and  for  evaluating  contractor  proposals. 

FINDING  5:  R&M  STANDARDS 

Advancing  technology  and  the  current  emphasis  on  R&M  point 
to  the  need  for  improvements  in  specific  R&M  standards. 

Comment ; 

A  recurrent  theme  from  the  R&M  study  group  reports  is  the 
lack  of  adequate  standards  in  certain  areas  particularly  related 
to  electronic  or  electromechanical  systems  where  there  are  cur¬ 
rently  rapidly  changing  technologies.  These  are  also  areas 
where  there  are  current  R&M  problems  in  the  field.  In  addition, 
deficiencies  were  noted  in  human  factors  R&M  requirements,  and 
in  the  design  specifications  for  reliable  use  of  composite 
materials.  Increased  emphasis  should  be  placed  on  reviewing 
and  updating  R&M  standards  and  specifications,  particularly  in 
the  areas  of  testing  procedures,  packaging  standards,  human 
factors  standards,  power  supply  design,  composite  materials 
use,  connector  standards  (including  fiber  optics),  and  software 
design.  A  further  deficiency  is  that  current  program  standards 
do  not  include  the  early  field  growth  and  maturation  phase  as  a 
requirement.  As  a  result  this  critical  phase  is  often  under¬ 
funded  and  ad  hoc  in  nature.  (Vol.  II,  Section  IV-A.4;  Vol .  Ill, 
Sect  ion  IV-A ) . 
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Recommendation ; 

It  is  recommended  that  a  Tri-Service  Board  he  convened  to 
develop  a  specific  implementation  plan  to  review  and  update 
within  the  next  24  months  standards  and  specifications  for  elec¬ 
tronic  or  electromechanical  systems,  specifically  related  to: 

•  Testing  procedures 

•  Packaging  standards 

•  Power  supply  design 

•  Software  design 

•  Connector  standards  (including  fiber  optics) 

and,  more  generally,  human  factors  standards  and  composite  mate¬ 
rials  design  specifications  as  they  relate  to  R&M  requirements. 
Further,  responsibility  should  be  assigned  to  revise  the  R&M 
program  and  supporting  MI L-Standa rds  to  formalize  the  require¬ 
ment  for  a  planned  maturation  phase. 

FINDING  6:  MANAGEMENT  INCENTIVES 


There  is  a  need  for  enhanced  management  awareness  of  R&M 
requirements  by  both  industry  and  government  managers  during 
the  acquisition  process. 

Comment : 

In  the  design  and  development  process  many  competing  pres¬ 
sures  have  to  be  balanced,  and  R&M  requirements  are  often  rele¬ 
gated  to  a  lower  priority  than  they  were  given  in  the  initial 
planning.  High  levels  of  contractor  management  participation 
in  R&M  were  evident  in  all  the  cases  in  which  R&M  was  deemed 
a  success.  Contract  incentives  have  proven  to  be  an  effective 
way  to  ensure  contractor  management  attention  to  R&M  requirements. 
Additionally,  contractors  respond  to  perceived  DoD  priorities. 

An  increased  understanding  by  DoD  managers  and  engineers  of  the 
critical  elements  of  R&M  programs,  how  those  elements  relate 
to  one  another,  and  what  they  contribute  to  R&M  success  would 
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facilitate  communications  with  contractors  that  would  lead  to  im 
proved  program  structures.  The  Services  should  then  be  better 
equipped  to  monitor  program  efforts  to  meet  R&M  requirements  dur 
ing  the  acquisition  process  (Vol.  II,  Section  IV-A;  Vol .  Ill, 
Sect  ion  IV) . 

Recommendation : 

It  is  recommended  that  the  Military  Departments  be  required 
to  prepare  and  report  to  the  Defense  and  Service  Systems  Acqui¬ 
sition  Review  Councils  ( DSARC/SSARCs )  their  plans  for  contractor 
incentives  related  to  R&M  requirements  at  each  major  milestone 
of  the  acquisition  process.  In  addition,  any  proposed  realloca¬ 
tion  of  funds  initially  programmed  for  R&M  elements,  parti¬ 
cularly  those  designated  for  component  and  subsystem  growth 
testing,  should  be  reported  along  with  projected  adjustments 
in  R&M  achievements  and  schedules. 

FINDING  7:  NEW  SYSTEM  MATURATION 

The  use  of  new  and  evolving  technology  in  system  develop¬ 
ment  requires  a  planned  and  funded  R&M  maturation  phase  that 
begins  early  in  system  development  and  continues  until  several 
years  after  a  system  is  fielded. 

Comment : 

It  should  be  recognized  that  when  systems  are  first  fielded 
they  generally  are  not  fully  developed,  i.e.,  they  are  still 
subject  to  failure  from  unforeseen  conditions  due  to  design 
deficiencies  or  unspecified  operational  demands.  In  spite  of 
the  best  design  and  manufacturing  efforts,  there  still  remain 
significant  unknowns  that  cannot  be  detected  and  addressed  until 
a  system  is  being  operated  and  maintained  in  the  field  by  the 
actual  user.  An  exception  may  be  spacecraft,  where  extensive 
use  of  redundant  systems  and  elaborate  testing  is  undertaken 
in  the  development/production  process  to  ensure  failure-free 
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operation.  For  most  systems,  however,  particularly  if  potential 
failures  are  not  seen  to  be  life-threatening,  the  expense  of 
such  elaborate  design  and  testing  is  not  justified,  provided  a 
well-organized  product  improvement  program  is  carried  out 
(Vol.  II,  Section  IV-A.4;  Vol.  Ill,  Section  IV). 

Recommendation ; 

R&M  growth  and  maturation  programs  for  major  equipments 
should  be  included  early  in  program  management  plans  and  carried 
through  to  satisfy  field  operations.  Such  programs  should 
include  rapid  feedback  of  field  failure  data,  use  of  contractor 
personnel  for  investigation  and  establishment  of  product  im¬ 
provement  changes,  and  rapid  approval  of  corrective  measures. 
Failure  data  should  also  be  fed  to  the  appropriate  Service 
laboratories  (see  Recommendation  8).  Where  appropriate,  equip¬ 
ment  could  be  bailed  back  to  the  laboratories  for  extensive 
testing.  The  program  should  continue  until  the  system  has 
satisfied  user  expectations. 

D.  SPECIFIC  AREAS  OF  CONCERN 

FINDING  8:  COLLECTION  AND  USE  OF  FIELD  R&M  DATA 


Current  methods  of  collection,  analysis,  and  dissemination 
of  field  R&M  data  are  not  sufficient  to  identify  underlying 
causes  of  failure  and  thus  facilitate  reliability,  maintaina¬ 
bility,  and/or  readiness  improvements. 

Comment ; 

Every  working  group  involved  in  this  study  implicitly  or 
explicitly  identified  a  need  for  better  information  on  the 
cause  of  failures  in  the  field  (Vol.  II,  Section  III;  Vol.  IV, 
Section  V).  The  normal  data  produced  by  the  maintenance  data 
collection  systems  usually  does  not  provide  the  kind  of 
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information  needed  for  engineering  analysis  of  failures.  Wide 
variations  in  the  results  of  using  data  from  the  same  data  base 
have  been  observed  in  the  course  of  this  study  (Vol.  Ill,  Section 
IV-B).  The  commercial  sector  is  far  ahead  of  the  military  in 
the  collection  of  accurate  data,  as  is  demonstrated  by  the 
grocery-store  laser  beam  bar-code  reader.  In  contrast,  the  cur¬ 
rent  military  data  systems  rely  mostly  on  the  handwritten  input 
of  maintenance  technicians,  or  in  some  cases,  special  data  col¬ 
lectors.  What  appears  to  be  needed  is  a  two-fold  approach  which 
involves  routinely  funding  contractor  data  collection  and  anal¬ 
ysis  for  design  feedback  during  early  fielding,  coupled  with 
application  of  low-risk  information  technologies  to  improve  the 
accuracy  of  data  collection  and  to  flag  problems  for  detailed  in¬ 
vestigation  by  experts.  The  DoD  laboratories  should  be  involved 
in  this  effort.  (Vol.  II,  Section  IV-B;  Vol.  Ill,  Section  IV). 

Recommendation : 

The  Military  Departments  should  initiate  programs  to  im¬ 
prove  the  accuracy  and  the  coverage  of  current  maintenance  data 
systems  by  exploiting  low-risk  information  systems  technol¬ 
ogy.  Lead  laboratories  should  be  designated  for  field  data 
analysis  in  major  technology  areas  and  should  be  supported  to 
initiate  research  studies  of  generic  problems,  in  order  to 
expand  the  technology  base  data  available  to  designers.  Con¬ 
tractors  should  be  routinely  funded  to  analyze  field  R&M  prob¬ 
lems  on  new  equipment. 

FINDING  9;  R&M  TRAINING  FOR  MANAGERS 

There  is  a  real  need  to  upgrade  the  level  and  scope  of  R&M 
training  throughout  DoD  and  to  relate  it  more  closely  to  current 
manpower  skill  levels. 
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Comment : 

Analysis  of  the  case  studies  indicates  that  contractors  do 
respond  to  perceived  DoD  priorities.  One  factor  that  contrib¬ 
uted  to  contractor  perception  of  the  importance  that  DoD  placed 
on  R&M  was  the  capability  and  knowledge  of  DoD  personnel  on 
R&M-related  items. 

Currently,  R&M  training  is  provided  by  a  number  of  separate 
DoD  Service  schools,  contractors  and  educational  institutions, 
but  it  is  fragmented  and  limited  in  scope.  As  a  result,  it  is 
essential  that  more  attention  be  focused  on  the  educational 
process  and  that  current  DoD  educational  bodies  take  steps  to 
coordinate  and  improve  the  content  of  their  acquisition  manage¬ 
ment,  reliability,  maintainability,  and  design  courses.  This 
training  will  lead  program  managers  to  understand  the  conse¬ 
quences  of  their  respective  programmatic  decisions  (Vol.  II, 
Section  IV-C;  Vol.  Ill,  Section  IV). 

Recommendation ; 

OSD  should  assign  executive  agent  responsibility  for  R&M 
training  to  an  existing  organization  with  instructions  to  work 
closely  with  all  DoD  training  institutions  in  developing  a  com¬ 
prehensive,  coordinated  R&M  curriculum. 

FINDING  10:  DIAGNOSTICS 


Diagnostics  and  in  particular  built-in-test  could  become 
the  weak  link  in  the  support  chain  if  substantial  efforts  are 
not  mounted  now  to  codify  requirements,  design,  verification, 
and  maturation  processes. 

Comment : 

Weapon  systems  have  become  heavily  dependent  on  built-in 
diagnostics  to  indicate  subsystems  and  units  which  must  be 
replaced.  Major  problems  have  occurred  on  a  wide  scale  in 
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achieving  accuracy  and  low  false  alarms.  A  substantial  increase 
in  spares  costs  and  unnecessary  repairs  results. 

Problems  in  acquiring  systems  with  diagnostics  that  work 
span  the  range  of  precision  in  requirements,  and  environment, 
design  practices,  verification  and  demonstration  approaches, 
and  maturation.  Solution  to  diagnostic  system  problems  has 
been  hampered  by  fractionation  of  design,  test  equipment,  and 
human  factors  efforts.  Thus  the  trade-offs  between  built-in 
and  external  diagnostics  are  not  well  established.  (Vol.  II, 
Section  1V-A.5;  Vol.  Ill,  Section  IV). 

Recommendations : 

DoD  should  assign  responsibility  for  development  of  a  set 
of  MIL-Standards  for  diagnostics  specification,  design,  devel¬ 
opment,  verification,  and  maturation  under  the  unifying  umbrella 
of  an  overall  program  plan.  These  efforts  must  be  supported 
with  full-time  personnel  and  adequate  resources. 

The  Services  should  fund  efforts  to  collect  and  analyze 
field  data  on  military  and  civilian  systems  with  extensive  built- 
in  diagnostics  to  quantify  relationships  between  diagnostic  per¬ 
formance  (detection,  isolation,  false  indications,  errors)  and 
support  system  effectiveness. 
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III. 


CONCLUSIONS  FROM  THR  TECHNOLOGY  STEERING  GROUP  REPORT 


The  findings  and  recommendations  presented  in  Section  II 
are  drawn  partially  from  the  Technology  Steering  Group  Report 
(Vol .  IV  of  this  study  report),  which  is  a  summary  of  the  15 
Technology  Working  Group  reports.  Their  conclusions  are  pre¬ 
sented  here  in  more  detail  under  four  major  headings:  Technology 
Base  R&M  and  Demons trat ion  Programs,  Specific  Interdependencies, 
The  Discipline  and  Structure  of  R&M  Management,  and  Research 
Thrusts. 

A.  TECHNOLOGY  BASE  R&M  AND  DEMONSTRATION  PROGRAMS 

As  discussed  in  Volume  IV,  Section  IV,  there  are  known  de¬ 
ficiencies  in  the  maturity  of  certain  technologies  in  the  tech¬ 
nology  base  which  restrict  our  ability  to  improve  system  failure 
rates  and  our  ability  to  maintain  system  performance  now  and  in 
the  future.  "Off-line"  maturing  is  required  to  address  these 
deficiencies.  The  need  is  to  mature  a  whole  class  of  new  tech¬ 
nologies  for  the  purpose  of  reducing  failures,  minimizing  their 
impact  on  operations,  and  reducing  the  effort  necessary  to  per¬ 
form  maintenance. 

There  are  three  essential  features  of  "off-line"  maturing 
as  it  is  proposed. 

•  A  set  of  technologies  should  be  matured  in  a  manner 
which  reflects  their  interdependencies  (Appendix  C, 

Vol.  IV). 

•  The  target  chosen  to  provide  the  measure  of  success 
both  in  performance  and  R&M  should  be  as  realistic  as 
possible,  if  not  improvement  to  an  existing  system. 

•  The  results  achieved  should  be  generalized  so  that  they 
may  become  the  new  level  of  acceptable  performance. 


There  are  a  number  of  approaches  to  this  "off-line"  dem¬ 
onstration  method.  One  approach  is  presented  in  the  form  of 
technology  road  maps  which  indicate  the  task  and  cost  schedules 
for  maturing  electronics,  structures,  and  propulsion  technologies 
(Figs.  2-4).  These  road  maps  integrate  the  improved  R&M,  deploy¬ 
ment  and  sustainability  requirements  associated  with  Year  2000 
goals,*  interdependency  requirements,  and  technology  needs  iden¬ 
tified  in  the  technology  working  group  reports.  The  road  maps 
are  organized  to  reflect  the  expert  opinions  of  the  individual 
working  groups  as  to  what  needs  to  be  done,  when  it  should  be 
done,  and  in  some  cases  how  much  it  can  be  expected  to  cost. 

These  road  maps  are  not  presented  as  a  prescription  for  success 
but  instead  represent  a  point  of  departure  for  each  service  to 
use  in  structuring  its  own  activity. 


*The  year  2000  goals  are  set  forth  in  Service  studies  described 
in  Vol.  IV. 
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FIGURE  2.  Electronics  Road  Map 


FIGURE  3.  Structures  Road  Map 


B.  SPECIFIC  INTERDEPENDENCIES 


Many  of  the  topics  that  the  study  explored  fall  into  the 
category  of  the  "overlooked  or  unexamined  assumptions"  in  deci¬ 
sion-making  (Appendix  C,  Vol.  IV).  The  results  of  these  over¬ 
sights  are  presented  here. 

The  management  challenge  posed  by  technology  interdepen¬ 
dency  is  to  change  the  priorities  accorded  to  individual  tech¬ 
nology  developments.  The  approach  proposed  is  to  establish 
technological  performance  targets  that  unequivocally  draw  the 
attention  of  everyone  in  the  system  to  their  importance  and 
that,  if  pursued,  will  bring  a  number  of  other  factors  into  the 
right  perspective.  Four  such  targets  are  presented: 

1.  Establish  an  alternative  to  the  existing  interconnect 
technology  to  cope  with  the  100  MHz  clock  frequencies 
of  the  ICs  of  the  1990s,  and  provide  system  level 
structures  to  enhance  control  of  equipment  status  and 
recon f igucat ions. 

2.  Provide  reliable,  efficient  power  supplies  for  elec¬ 
tronics  capable  of  delivering  the  1-volt  high-amperage 
DC  power  required  by  VLSIC/VHSICs  with  power  densities 
in  the  10  W/in.^  range. 

3.  Establish  high-confidence  estimates  of  "failure-free" 
periods  of  performance  for  critical  military  subsystems. 
This  requirement  is  an  extension  of  the  ability  of 
health  monitoring  systems  to  capture  incipient  failures 
so  as  to  allow  weapon  systems  to  continue  battle  action 
prior  to  cycling  them  back  to  a  repair  facility.  (This 
capability  is  presently  more  mature  for  mechanical 
systems  than  for  electronic  systems). 
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Identify  all  the  implications  of  the  increased  use  of 
composite  materials  in  the  structures  of  military  plat¬ 
forms.  This  need  is  brought  about  by  the  constantly 
increasing  use  of  composite  materials  in  military  sys¬ 
tems.  The  side  effects  of  this  evolution  create  new 
design  requirements  and  challenges  for  platform  and 
electronics  design  engineers. 

The  concept  of  technology  performance  targets,  when  com¬ 
bined  with  the  strategic  goal  of  "off-line"  maturing,  results 
in  road  maps  for  the  conduct  of  research  and  development  (Figs. 
2-4)  . 


C.  THE  DISCIPLINE  AND  STRUCTURE  OF  R&M  MANAGEMENT 

The  techniques  of  establishing  requirements  and  structuring 
them  to  achieve  the  desired  fielded  capability  are  often  flawed. 
Past  efforts  often  resulted  in  requirements  for  unrealistic 
performance  levels  based  on  applications  of  new  technology 
evolving  from  the  technology  base  but  without  sufficient  knowl¬ 
edge  of  the  associated  reliability  and  support  requirements. 

The  result  has  been  fielded  systems  that  fall  far  short  of 
original  expectations. 

The  need  to  change  this  situation  is  highlighted  by  the 
arrival  of  the  "system  on  a  chip."  The  complexity  of  modern 
systems  such  as  directed  energy  devices  or  super  computers, 
whose  structures  appear  as  collections  of  imbedded,  highly 
complex  subsystems,  presents  the  possibility  that  feasibility 
may  be  driven  by  system  reliability  concerns.  There  will  have 
to  be  early  considerations  during  the  R&D  process  as  to  how 
these  imbedded  subsystems  relate  to  one  another.  The  Directed 
Energy  Study  (IDA  Record  Document  D-32)  addresses  this  type  of 
problem. 
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One  further  claim  can  be  made  for  the  early  consideration 
of  reliability  and  maintainability.  A  common  theme  of  these 
studies  was  that  the  kinds  of  considerations  that  can  lead  to 
successful  proof  of  concept  often  are  the  same  as  those  that 
would  lead  to  savings  in  downstream  costs  (i.e.,  life-cycle 
costs).  In  several  instances  such  awareness  has  existed.  How¬ 
ever,  due  to  the  way  in  which  priorities  have  been  set  in  the 
evolution  of  these  systems,  key  elements  were  often  given  super¬ 
ficial  treatment.  One  of  the  reasons  for  this  oversight  is  that 
the  consequences  of  a  design  decision  are  presently  not  known 
until  much  later  in  the  life  of  a  system.  Thus,  the  fault,  when 
it  does  occur,  is  buried  deep  within  the  design  and  seldom  cor¬ 
rected;  a  band-aid  or  patch  is  introduced  as  the  only  realistic 
option  available  at  the  time  the  fault  is  finally  recognized. 

The  study  found  that  there  were  widely  differing  skill 
levels  in  dealing  with  these  problems.  As  a  result,  there  are 
various  straightforward  criteria  which  could  be  used  by  OSD  to 
determine  whether  or  not  the  broad  interests  of  the  DoD  are 
being  met.  In  Fig.  5  the  shaded  boxes  highlight  those  areas 
where  deficiencies  were  noted  in  each  report. 

D.  RESEARCH  THRUSTS 

The  fifteen  working  group  reports  indicated  a  number  of 
research  topics  which  in  the  aggregate  point  to  six  lines  of 
scientific  inquiry.  In  each  of  these  lines  of  inquiry,  a 
significant  amount  of  detailed  research  and  effort  should  be 
actively  pursued.  The  areas  are;  composites,  manpower,  corro¬ 
sion,  predictive  techniques,  diagnostics,  and  architecture  for 
rel i abi 1 i ty . 

1 .  Compos i tes 

Increased  use  of  composites  will  highlight  additional 
deficiencies  in  our  scientific  understanding  of  these  materials. 
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Research  into  adhesives  and  the  bonding  of  different  materials 
underlies  many  of  the  potential  issues.  This  is  another  area 
where  attention  should  be  sustained  to  ensure  that  adequate  re¬ 
sources  are  applied  for  a  significant  period  of  time. 

2 .  Manpower 

The  research  base  underlying  the  design  trade-off  process, 
especially  for  human  factors,  has  been  and  continues  to  be 
deficient.  The  importance  of  continuing  and  expanding  this  base 
of  knowledge  is  increased  with  the  advent  of  more  imbedded 
complexity  and  the  forecast  patterns  of  demographic  change. 

3.  Corrosion 


Corrosion  has  historically  had  a  severe  impact  and  promises 
to  continue  as  an  important  failure  mechanism  in  the  advanced- 
technology  systems  of  the  next  two  decades.  A  new  focus  on 
this  age-old  issue  is  necessary  to  support  corrective  actions 
for  the  anticipated  problems. 

4 .  Predictive  Techniques 

A  number  of  physical  phenomena  explain  the  chain  of  events 
that  precede  a  failure.  The  material  science  discipline  is 
leading  the  way  to  making  understanding  of  those  phenomena 
applicable  to  the  management  of  failure  in  mechanical  systems, 
potentially  achieving  a  sufficient  alert  to  allow  for  preventa¬ 
tive  repairs  to  be  scheduled.  There  is  an  analog  in  electronic 
systems  that  is  not  being  adequately  addressed.  The  precursors 
to  electronic  failure  and  schemes  to  detect  them  could  lead  to 
enhanced  diagnostics  and  an  improved  ability  to  estimate  the 
time  to  failure  of  a  component  or  system. 
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5. 


Diagnost ics 

In  the  context  of  this  study,  diagnostics  are  addressed  for 
both  electronic  and  mechanical  systems.  For  electronic  systems, 
the  primary  emphasis  has  been  in  the  area  of  automatic  built-in 
test,  f au lt-i so lat ion  test  and  related  testability  issues.  For 
mechanical  systems,  the  emphasis  has  been  on  condition  and 
health  monitoring  and  nondestructive  evaluation  techniques. 

During  the  era  when  discrete  components  were  used  in  quan¬ 
tity,  it  was  possible  to  probe  electronic  assemblies  to  isolate 
failures.  Now  there  are  layers  of  hermetic  seals  and  programs 
stored  in  memory  that  obscure  the  technician's  view  into  the 
physical  processes  of  system  operation.  The  whole  discipline 
of  diagnostics  is  in  a  state  of  flux  caused  by  the  rapid  advance 
of  hardware  complexity  behind  the  interface.  The  research  base 
should  be  reassessed  to  ensure  that  the  various  disciplines 
that  could  contribute  to  the  solution  of  the  diagnostics  prob¬ 
lem  are  properly  funded  (see  Case  Study  Analysis,  Volume  III). 

6 .  Architecture  for  Reliability 

The  need  to  understand  new  concepts  for  fault  tolerance 
and  automatic  reconfiguration  is  latent  throughout  this  study. 
Now  that  systems  on  a  chip  are  feasible,  it  is  possible  to 
reconsider  redundancy  and  other  schemes  of  isolating  component 
failures  from  system  failures.  The  theoretical  basis  for  vari¬ 
ous  schemes  needs  to  be  strengthened.  The  array  of  ongoing 
research  tasks  should  be  addressed  to  determine  what  in  addition 
could  be  undertaken.  As  an  example,  non-Von  Neumann  architec¬ 
tures  or  multiprocessor  data  flow  machines  for  computers  may 
have  uniquely  different  failure  schemes  from  the  present-day 
systems . 
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IV. 


CONCLUSIONS  FROM  THE  CASE  STUDY  ANALYSIS 


Additional  findings  and  recommendations  were  drawn  from  the 
Case  Study  Analysis,  Volume  III  of  this  study.  It  was  concluded 
there  that  high-payoff  R&M  actions  are  currently  known  that  must 
be  planned  for  and  retained  in  the  weapon  system  acquisition 
process  and  programs.  These  are  discussed  below  under  the 
following  headings:  Structure  to  Manage  Interdependent  Program 
Elements,  Reliability  Design  Tools  and  Processes,  Off-line  Mat¬ 
uring  of  Subsystems  and  Components,  R&M  Growth  and  Maturation, 
and  Diagnostics.  In  addition,  findings  were  made  in  the  areas  of 
Information  and  Education  as  they  relate  to  R&M  concerns. 


A.  HIGH  PAYOFF  ACTIONS  IN  THE  ACQUISITION  PROCESS 


1 .  Structure  to  Manage  Interdependent  Program  Elements 

a.  Observations :  The  R&M  elements  of  the  acquisition 
process  are  well-known;  however,  the  interrelationships  and  de¬ 
pendencies  of  elements  and  subelements  are  less  well  understood. 
As  a  consequence,  management  decisions  have  traded  away  R&M  pro¬ 
gram  elements  for  small  cost  and/or  schedule  savings  up  front, 
which  ultimately  led  to  costly  overruns,  schedule  delays,  and 
downstream  logistics  problems. 

b.  Findings :  The  management  challenge  posed  by  the  inter¬ 
dependency  issue  is  to  structure  a  single  acceptable  disciplined 
approach  to  planning  programs  to  ensure  balanced  considerations 
of  performance,  budget,  schedule,  and  supportabi li ty.  Once 
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programs  are  so  structured,  the  discipline  must  provide  for  con¬ 
tinuing  analysis  and  monitoring  to  ensure  that  the  appropriate 
balance  is  maintained  as  the  program  progresses  through  its 
various  phases. 

This  disciplined  approach  must  also  recognize  the  depend¬ 
ency  relationship  among  the  program  elements.  For  example, 
good  reliability  predictions  depend  on  a  good  definition  of 
how  the  hardware  will  be  used  and  subsequently,  a  good  environ¬ 
mental  analysis.  These  dependencies  result  in  many  elements 
being  "necessary”  but  few  (or  none)  being  "sufficient"  in  and 
of  themselves,  to  achieve  satisfactory  or  ultimate  performance. 
The  structured  process  may  have  more  than  one  path  to  success 
but  numerous  paths  exist  that  will  lead  to  problems  that  will 
result  in  unsatisfactory  reliability  or  maintainability. 

c.  Action :  The  Services  should  analyze  and  develop  a  dis¬ 
ciplined  for  managing  interdependent  program  elements  including 
appropriate  data  bases  and  parameters  and  include  these  in  their 
acquisition  strategy. 


Rel  iabi  1  it\ 


Tools  and  Processes 


a.  Observations :  Design  actions  must  identify  and  balance 
the  stresses  on  various  elements  of  the  equipment.  Reliability 
design  tasks  include  environmental  estimation,  stress  analyses, 
part  selection  and  part  derating.  These  tasks,  in  combination, 
define  (or  estimate)  the  operating  environment  of  the  equipment, 
predict  the  stress  on  the  individual  part  or  component,  select 
a  part  that  can  operate  effectively  in  that  environment  and,  in 
the  case  of  most  electronics  items,  derate  the  part  to  provide 
a  margin  of  safety  between  the  rated  stress  and  the  estimated 
operating  stress.  These  activities  are  fundamental  to  producing 
a  reliable  design.  CAD  has  the  potential  to  make  R&M  a  part  of 
the  mainstream  design  engineering  by  including  R&M  as  a  design 
requirement  and  having  integrated  R&M  design  capabilities. 

IV-  2 


820/4-2 


Even  if  R&M  design  procedures  are  improved  it  must  he  ex¬ 
pected  that  most  types  of  manufactured  items  will  initially  have 
some  part  and  workmanship  defects.  To  prove  out  manufacturing 
processes  before  fielding,  environmental  stress  screening  (ESS) 
is  needed.  The  ESS  approach  is  to  apply  thermal,  electrical 
and  mechanical  stress  to  precipitate  failure  of  the  weak  parts 
and  assemblies  in  the  factory  and  thereby  result  in  improved 
reliability  in  field  use.  All  the  electronics  case  study  pro¬ 
grams  used  ESS  to  some  degree  (see  Fig.  6).  There  was  consid¬ 
erable  variation  in  the  details  of  the  applications,  but  all 
programs  benefited  from  improved  reliability.  Other  studies 
have  shown  that  ESS  reduces  manufacturing  costs  and  significantly 
improves  productivity,  because  of  reduction  in  rework  and  associ¬ 
ated  retesting.  Dramatic  increases  in  operational  reliability, 
due  to  ESS,  e.g.,  some  more  than  10  to  1,  were  also  documented 
( see  Fig .  7  ) . 

b.  Findings :  The  findings  for  ESS  and  CAD  are  as  follows. 
The  design  system  needed  is  computer-aided  design  (CAD)  supported 
by  an  R&M  data  base  and  tied  to  computerized  R&M  and  logistics 
analyses.  Integration  of  R&M  tools  and  analyses  into  CAD  will 
provide  design  engineers  the  disciplined  use  of  specialized 
knowledge  in  real  time  with  potentially  dramatic  reductions  in 
cos  t . 

In  much  the  same  way  the  integration  of  computer-aided  manu¬ 
facturing  (CAM)  with  CAD  can  enhance  both  design  and  manufactur¬ 
ing.  Integrated  CAD/CAM  can  provide  designers  with  knowledge 
of  manufacturing  constraints  which  can  lead  to  a  more  consistent 
production  process. 

The  ESS  approach  should  be  developed  during  the  design  and 
development  phase.  ESS  should  be  employed  on  test  hardware  so 
that  expensive  tests  are  not  delayed  due  to  design  and  workman¬ 
ship  problems.  Results  should  be  analyzed  to  provide  informa¬ 
tion  needed  to  refine  screens  prior  to  beginning  production. 

The  ability  to  adjust,  add  or  delete  screens  is  necessary  to 
achieve  the  ultimate  ESS  benefits. 
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FIGURE  6.  Stress  Screening  Use 


88/33-1 


IV- 4 


•  ARN-84  TACAN 


FIELD  MTBF 
FIELD  MTBF 

•  DEPOT  REPAIR  COST  AVOIDANCE 

•  SPARE  REQUIREMENTS  REDUCED 

•  UNIT  COST  OF  EQUIPMENT  TO  SERVICE  UNCHANGED 

•  YEARLY  REPAIR  SAVINGS  =  6%  OF  PURCHASE  PRICE 

FIGURE  7.  ARN-84  Reliability  Improvement  due  to  ESS 


200  (Before  ESS) 
2000  (After  ESS) 

S5M/YR 


820/4-5 


IV-5 


ESS  applied  during  early  production  serves  as  a  "find-and- 
fix"  program  in  which  manufacturing  process  problems  and  some 
latent  design  deficiencies  are  identified  and  corrected.  Stress 
screens  should  be  determined  after  consideration  of  the  process 
controls  which  can  prevent  introduction  of  manufacturing  de¬ 
fects  and  after  evaluation  of  test  and  inspection  approaches. 
Stress  screens  should  not  be  used  in  lieu  of  possible  preven¬ 
tative  action,  since  preventative  action  is  almost  always  less 
expensive  and  usually  results  in  a  more  reliable  product. 

The  reliability  potential  of  ESS  is  so  significant  that  it 
warrants  special  attention.  All  electronics  development  and 
production  programs  should  require  ESS.  ESS  applications  should 
be  described  in  a  plan  and  must  be  dynamic  in  nature  and  struc¬ 
tured  so  that  maximum  screening  effectiveness  is  obtained.  Cost 
models,  yield  and  rework  data  and  failure  data  should  be  main¬ 
tained  to  demonstrate  effectiveness  of  the  program.  Periodic 
reports  showing  the  status  of  screening  results  should  be 
provided  to  management. 

c.  Action ;  DoD  should  invest  in  CAD  systems  and  in  ESS 
approaches  that  address  R&M  problems  in  order  to  mature  and 
understand  their  use.  Demonstration  programs  should  be  selec¬ 
tively  funded  and  carefully  evaluated.  Also,  a  policy  should 
be  formulated  to  ensure  ESS  is  applied  to  all  acquisitions. 

3 .  "Off-Line"  Maturing  of  Subsystems  and  Components 

a.  Ohservat ions :  Within  a  total  weapon  system  program 
context,  the  off-line  maturing  of  system  and  subsystem  elements 
offers  significant  risk  reduction  for  today's  concurrent  program 
environment.  The  T700  engine  program  represents  a  classic  ex¬ 
ample  of  successful  off-line  development  and  insertion  into  a 
program  with  provisions  for  maturation  (see  Fig.  13). 
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b.  Findings :  In  addition  to  this  observation  from  the 
T700  program,  the  technology  portion  of  this  study  recommended 
three  essential  features  of  "off-line"  maturing  that  are  re¬ 
emphasized  here.  The  first  is  that  a  set  of  technologies  should 
be  matured  in  a  manner  which  reflects  their  interdependencies. 
Second,  the  target  chosen  to  provide  the  measure  of  success 
should  be  as  realistic  as  possible,  if  not  improvement  to  an 
existing  system.  Third,  the  results  achieved  should  be  gener¬ 
alized  and  become  the  new  level  of  acceptable  performance. 

From  a  programmatic  point  of  view,  the  management  issue  becomes 
one  of  when  is  the  technology  ready  for  program  insertion  and 
what  actions  will  minimize  the  risk  of  doing  it.  There  is  no 
simple  answer  for  these  questions  but  the  integrated  approach 
to  technology  maturation  discussed  in  Volume  IV,  Section  V, 
coupled  with  evolution  of  the  disciplined  structured  approach 
as  discussed  in  Volume  III,  Appendix  B,  could  result  in  a 
significant  reduction  in  risk  for  new  programs. 

c.  Action :  The  need  for  off-line  component  and  subsystem 
development  should  be  evaluated  on  each  DSARC  program  as  well 
as  on  less  major  systems.  Guidelines  should  be  developed  for 
concurrent  programs  to  routinely  fund  such  developments. 

The  Services  should  also  increase  their  technology  base 
efforts  for  programs  with  objectives  such  as  the  Air  Force 
ultra-reliable  radar  program. 

4.  R&M  Growth  and  Maturation 


a.  Observations ;  Without  exception,  the  case  studies 
showed  that  despite  the  best  design  efforts,  problems  will  be 
found  in  development  testing,  production,  and  in  field  use.  An 
example  from  the  APG-66  program  is  typical  (Fig.  8).  These 
facts  support  the  rationale  that  testing  and  growth  programs 
are  essential  elements  to  producing  reliable  equipment. 
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R&M  growth  programs  should  be  oriented  to  supplement  effective 
design  and  manufacturing  processes. 

A  comprehensive  growth  and  maturation  program  is  more  than 
just  a  test  phase  labeled  reliability  growth  or  reliability  de¬ 
velopment  testing.  It  is  a  coordinated  effort  starting  in  the 
conceptual  phase,  influencing  the  design  phase,  reaching  across 
the  whole  test  program  and  extending  a  reasonable  period  of  time 
into  field  use.  A  well-executed  growth  and  maturation  program 
requires  adequate  resources  for  data  gathering,  data  review  and 
analysis,  and  for  engineering  manpower  assigned  to  investigate, 
resolve  and  correct  problems  as  well  as  an  expedited  change 
processing  system  to  allow  rapid  incorporation  of  problem 
correct  ions . 

It  is  essential  that  built-in  test  (BIT)  development  be 
structured  to  have  a  parallel  growth  and  maturation  program 
(see  Volume  III,  Section  IV-A  for  diagnostics  observations). 

The  BIT  in  all  of  the  cases  studied  required  a  period  of  concen¬ 
trated  maturation  before  the  RIT  performance  reached  an  accept¬ 
able  level. 

It  is  clear  from  some  programs  reviewed  that  additional 
classes  of  problems  occur  when  equipment  enters  production  ar i 
again  when  it  enters  operational  service  (Fig.  9).  These 
problems  must  be  identified  and  corrected,  or  the  system  will 
be  plagued  with  the  problems  for  its  entire  operational  life. 

b.  Fj nd i nqs ;  A  comprehensive  R&M  growth/maturation  pro¬ 
gram  starts  early  in  the  conceptual  planning  phase,  continues 
through  the  design  phase,  influences  component  development 
testing  and  continues  into  the  operational  phase.  The  programs 
evaluated  in  these  case  studies  showed  only  a  limited  amount 
of  growth  planning  and  testing.  The  reliability  improvement 
warranty  (RIW)  programs  on  the  APG-66  and  the  LDNS  were  the 
only  planned  efforts  that  extended  for  any  significant  time 
into  the  operational  phase.  The  following  sections  will  provide 
perspective  on  the  front-end  design  effort  and  the  plans 
necessary  to  manage  a  growth  program  adequately. 
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( 1 )  Front-End  Design  Efforts  for  R&M 

Appendix  B  to  Vol .  Ill  identifies  the  structure  for  design¬ 
ing  R&M  into  weapon  system  programs.  The  R&M  elements  cited 
there  were  considered,  to  various  degrees,  in  all  the  case 
studies  evaluated.  The  results  of  these  studies  indicate  that 
the  front-end  design  effort  led  to  higher  levels  of  R&M  at  the 
start  of  the  test  phase. 

( 2)  Management  Environment  for  R&M  Growth 

DoD  policy  and  major  acquisition  contracts  should  provide 
for  integrated  R&M  growth  programs,  with  proper  incentives  for 
R&M  growth.  Acquisition  programs  must  improve  their  responsive¬ 
ness  to  engineering  change  proposals  (see  Fig.  10  for  variances 
in  flow  duration).  Formal  configuration  control  should  be  de¬ 
layed  as  long  as  practical.  Guidelines  should  he  developed  for 
tailoring  management  of  ECPs  during  the  R&M  change  introduction 
process,  and  these  should  be  taught  to  managers  and  enforced  at. 
all  levels.  Programming  and  budgeting  should  include  resources 
for  this  effort. 

The  growth  must  start  with  the  beginning  of  hardware  test¬ 
ing  and  extend  two  to  three  years  into  field  operation.  A 
typical  growth  profile  is  shown  in  Fig.  11.  A  test-anal yze-and- 
fix  philosophy  must  prevail  throughout  all  aspects  of  a  pro¬ 
gram.  Each  phase  must  make  efficient  use  of  the  test  resources. 

An  accurate  and  timely  failure  feedback  procedure  is  neces¬ 
sary  to  provide  the  designer  with  information  to  accomplish  the 
required  corrective  action.  Achievement  of  this  feedback  during 
early  field  operation  will  require  on-site  engineering  support  . 

( 3 )  Maturing  the  Support  Structure 

Today's  complex,  highly  interactive  systems  require  the 
growth  and  refinement  of  the  other  factors  to  realize  the  full 
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FIGURE  II.  Typical  Growth  Profile 


potential  of  reliability  and  maintainability.  These  factors 
include:  diagnostics,  manpower  and  human  factors,  training, 

technical  data,  support  equipment,  and  software.  Very  signifi¬ 
cant  improvement  in  readiness  and  sustainability  can  be  realized 
if  the  total  support  structure  is  matured  in  a  systematic  way. 

( 4 )  Fund inq 

The  growth  and  maturation  program  for  reliability  and 
diagnostics  is  critically  dependent  on  front-end  funding,  which 
must  be  structured  with  full  identification  of  the  activities 
discussed  above  and  with  particular  attention  given  to  adjunct 
test  hardware. 

A  conceptual  view  of  current  versus  needed  funding  profiles 
is  given  in  Fig.  12.  Further  analysis  would  be  needed  to  define 
the  details  of  an  actual  funding  profile;  Figure  12  is  intended 
only  to  visualize  an  apparent  current  problem. 

c.  Action :  R&M  Program  Ml L-Standa rds  should  be  revised  to 
include  a  plan  for  an  integrated  development  and  field  Rs.M  growth 
pla  n . 
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FIGURE  12.  Funding  Profile  for  RDT&E 


5.  Diagnostics 

a.  Observations :  Diagnostic  systems  development  is  an 
immature  discipline  when  compared  to  reliability.  In  diagnos¬ 
tics,  there  are  no  accepted  definitions  of  requirements  that 
can  be  used  for  contracting  that  are  directly  understandable 
to  a  designer  and  that  can  be  related  to  field  performance. 

On  the  other  hand,  for  reliability,  there  are  design  tools  for 
analysis  of  the  stresses  that  cause  failures  as  well  as  for 
predicting  failure  rates  of  components,  subsystems  and  systems. 
Design  tools  for  diagnostics  are  much  less  structured  and 
pract iced . 
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In  reliability  testing,  there  are  proven  techniques  for 
simulating  the  operational  stresses  an  equipment  will  undergo, 
weeding  out  the  causes  of  unreliability  and  verifying  the  poten¬ 
tial  system  reliability.  Diagnostics  testing  techniques  are 
much  less  mature.  Though  fault  insertion  tests  are  performed 
in  the  lab,  they  are  poor  predictors  of  field  performance.  A 
comparison  of  results  from  laboratory  fault  insertion  tests 
and  field  operational  tests  is  shown  in  Fig.  13.  It  will  iden¬ 
tify  some  problems,  hut  success  in  such  a  demonstration  is  no 
guarantee  of  a  good  design.  Thus,  demonstration  by  fault 
insertions  are  necessary,  but  not  sufficient,  to  validate  a 
diagnostics  design. 

Lack  of  knowledge  in  the  diagnostics  area  (contracting, 
statement  of  requirements,  design,  testing,  deployment)  presents 
a  significant  challenge  to  the  development  community  to  improve 
diagnostics  of  current  weapon  systems  and  acquisition  methods 
for  improved  diagnostics  in  future  weapon  systems.  Fundamental 
work  is  required  in  all  these  facets  of  weapon  program  develop¬ 
ment  to  produce  acceptable  diagnostic  capabilities  for  field  use. 

b.  Findings :  From  the  case  study  activities  and  numerous 
other  studies  and  presentations  reviewed,  it  is  clear  that  the 
achievement  of  a  mature  diagnostics  capability  is  the  result  of 
a  defined  process.  This  process  encompasses  both  research  and 
development  activities,  which  are  not  weapon  program  specific, 
as  well  as  the  acquisition  process,  which  can  be  weapon  program 
specific.  Achieving  effective  diagnostics  requires  a  plan,  man¬ 
agement  strategy,  motivation,  technical  activity,  and  funding 
that  spans  system  acquisition  from  initial  requirements  defini¬ 
tion  through  deployment. 

( 1 )  Statement  of  Requirements 

The  military  user's  requirements  should  address  diagnostic 
capability  in  the  larger  context  of  the  operational  mission  and 
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FIGURE  13.  Typical  Fault  Insertion  Test  Results  versus  Field 
Results 
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environment  as  well  as  the  support  constraints  of  manpower,  the 
skill-level  maintenance  concept,  deployment,  and  the  logistics 
burden.  The  requirements,  constraints,  environment,  and  econom¬ 
ics  should  then  drive  the  architecture  of  the  system,  diagnos¬ 
tics  being  one  of  the  fundamental  characteristics.  Significant 
information  improvements  are  needed  for  formulating  these 
requi rements . 

Definitions,  terminology,  and  figures  of  merit  to  describe 
diagnostics  requirements  have  proliferated  to  the  point  that 
commun icat ion  relative  to  diagnostics  measures  is  difficult. 

This  is  not  a  trivial  problem;  it  impedes  the  way  diagnostics 
are  specified,  managed,  designed,  tested,  and  measured.  Proposed 
MIL-STD-XXX,  "Testability  Program  for  Electronic  Systems  and 
Equipment,”  and  MIL-STD-1309  are  useful  but  not  sufficient  steps 
to  resolve  this  problem.  Better  ways  of  specifying  diagnostics 
requirements  are  needed  to  achieve  the  readiness  and  support 
goals  of  the  Services. 

( 2 )  Des ign 

In  the  area  of  diagnostics  system  design,  the  following 
needs  have  been  identified: 

a.  Strategies  to  minimize  cannot  duplicate  fCND),  bench- 
checked  serviceable  (BCS),  retest  OK  ( RTOK ) ,  and  false 
alarm  conditions  during  design. 

b.  Techniques  to  maximize  vertical  testability. 

c.  A  flexible  diagnostic  system  so  that  changes  can  be 
incorporated  readily  in  diagnostic  algorithms,  screens, 
and  tolerances  with  minimal  hardware  impact. 

d.  Fault-free  software  development  techniques. 
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Techniques  to  enable  more  concurrent  hardware  and 
software  development  and  earlier  integration  of  the 
two . 


f.  Trade-off  tools  for  assessing  the  diagnostics  impli¬ 
cations  of  design  decisions  on  the  support  structure. 

g.  Computer-aided  engineering  techniques  for  enhancing 
design  for  testability  in  support  of  proposed  MIL- 
STD-XXX.  (Some  techniques  such  as  LOGMOD  and  STAMP 
may  already  be  able  to  meet  this  need,  though  they 
are  not  widely  used.) 

h.  Both  the  Services  and  contractors  need  to  develop 
experienced  people  who  understand  how  to  achieve  good 
diagnostics  designs. 

i.  Tools  for  predicting,  measuring,  and  managing  the 
diagnostics  designs. 

j.  Better  design  practices  such  as  control  of  timing 
margins  in  high-speed  circuits  and  systems. 


Development  and  Demonstration  Test 


Improvements  in  development  and  demonstration  testing  will 
aid  diagnostics  development.  The  following  measures  have  been 
suggested  by  experts  in  the  field: 


a.  Use  reliability  and  other  test  events  as  opportun¬ 
ities  to  discover  problems  with  BIT  performance. 
Environmental  testing  may  be  particularly  useful 
for  discovering  false-alarm  indications  such  as 
induced  intermittents  and  transients. 
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b.  Increase  the  number  of  spare  assets  and  the  time 
budgeted  in  the  system  integration  laboratory  to 
investigate  diagnostic  anomalies  without  impacting 
the  schedule  and  use  of  other  assets. 

c.  Expand  the  set  of  faults  inserted.  (Time  required 
for  fault  insertion  tests  might  have  to  increase.) 

d.  Increase  the  allowable  cost  of  demonstrations  to 
include  repair  costs.  This  action  will  permit  the 
insertion  of  a  better  cross-sect  ion  of  faults. 

e.  Develop  a  library  of  computer  simulation  models  to 
test  BIT  (hardware,  software,  firmware). 

f.  Adopt  comparability  analysis  as  a  useful  tool  for 
identifying  a  realistic  fault  set  for  insertion. 

g.  Develop  and  incorporate  in  MIL-STD-471  improved 
demonstration  techniques  to  predict  field  diagnostics 
pe  rformance . 

( 4 )  Operational  Test  and  Field  Maturation 

Field  maturation  is  essential  to  achieve  inherent  diagnos¬ 
tics  potential.  When  a  system  is  first  fielded,  it  is  common 
to  find  that  not  all  the  hardware  and  software  provisions  of 
the  diagnostics  have  been  fully  implemented.  In  addition,  the 
operational  use  patterns  and  the  environment  produce  new  failure 
modes  and  diagnostics  indications.  These  new  indications, 
which  the  BIT  may  not  deal  with  properly,  are  resolved  by  the 
judgment  of  operators  and  maintainers  (who  may  not  have  been 
trained  to  deal  with  them)  with  the  aid  of  technical  data 
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(which  may  not  have  been  developed  to  address  them).  A  struc¬ 
tured  diagnostics  maturation  effort  is  the  only  way  most  experts 
see  to  bring  the  diagnostic  capability  to  its  full  potential. 

The  APG-65  and  APG-66  programs  are  excellent  examples  of  effec¬ 
tive  BIT  maturation.  Figure  14  indicates  the  rate  of  diagnos¬ 
tics  growth  of  the  APG-66  radar  during  the  FSD/product ion 
phases.  The  key  features  of  these  programs  should  be  used  in 
structuring  future  maturation  efforts  for  complex  equipment. 

c.  An  Approach  to  Planning  Future  Avionic  Diagnostics:  In 
addition  to  the  above  activities,  Appendix  E  of  Vol.  Ill  includes 
an  illustration  of  how  a  system  might  be  structured  to  achieve 
significant  diagnostic  improvement.  This  approach  is  oriented 
specifically  toward  avionics,  but  the  thought  process  should 

be  useful  for  other  applications  as  well.  Regardless  of  the 
system  type,  diagnostics  capability  must  be  considered  as  a  fun¬ 
damental  concern  in  the  conceptual  phase  of  system  architecture 
development . 

In  the  world  of  avionics  diagnostics,  bold  steps  are  neces¬ 
sary  to  improve  radically  performance  in  the  field  and  reduce 
substantially  the  cost  of  maintenance.  Support abi 1 i ty  improve¬ 
ments,  particularly  the  contributions  of  avionics  diagnostics, 
require  new  approaches  to  solve  the  problems  faced  by  the  Ser¬ 
vices  in  the  field  today.  Technology  improvements  appear  to 
offer  the  opportunity  to  make  strides  toward  such  improvement. 
Advanced  architectures  provide  the  means  to  achieve  improved 
support abi 1 i ty . 

d.  Action :  An  agency  should  be  designated  to  be  respon¬ 
sible  for  developing  a  structured  process  for  carrying  diagnos¬ 
tics  through  from  stating  requirements  to  design,  development, 
test,  and  maturation.  The  most  natural  vehicle  for  this  would 
be  a  diagnostic  standardization  program  similar  to  those  started 
for  reliability  in  the  last  10-15  year  time  period  at  both  Dol) 
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and  NASA.  In  addition,  there  is  need  to  establish  an  R&D  program 
to  develop  the  technologies  required  to  solve  current  problems 
(false  alarm  and  unnecessary  removals). 


B.  INFORMATION 

1 .  Cone lus ion 


Accurate  and  detailed  eng i neer i ng-qua 1 i ty  information  on 
system  and  component  failures  must  be  provided  for  identifying 
and  solving  equipment  problems  and  focusing  technology  efforts. 

2.  Observations 


A  thorough  understanding  of  how  each  military  Service  oper¬ 
ates  and  a  comprehensive  investigation  and  analysis  of  the 
sources  of  data  are  necessary  if  one  is  to  avoid  misinterpreting 
reported  data.  Wide  variations  in  results,  using  data  obtained 
from  the  same  data  base  and  reported  in  numerous  studies  and 
briefings,  have  been  observed  in  the  course  of  this  study. 

Five  examples  are  provided  in  Vol.  Ill  as  follows: 

1.  Impact  of  the  F-16  fleet  electrical  mciification 

2.  F-15  and  F-16  radar  removal  data 

3.  Impact  of  installation  of  maintenance  data  terminals 
at  all  F-16  bases 

4.  Impact  of  installation  of  data  terminals  at  Dover  AFB 
for  the  C-5A 

5.  T-38  base-to-base  comparison  of  avionics  reliability. 
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Based  on  analysis  of  the  cases  listed  above,  the  following 
findings  were  made. 

3 .  Fi nd i nqs 

The  planned  operational  concepts,  as  reflected  in  the  Ser¬ 
vice  Year-2000  studies,  and  the  complexity  of  current  and  planned 
weapon  systems,  make  it  essential  that  data  systems  he  capable 
of  supporting  units  in  combat  as  well  as  peacetime,  and  be  user 
oriented  (e.g.,  Automated  Data  Entry)  for  accuracy  and  speed. 

The  Army  SDC  system  provides  a  reasonable  solution  for  manage¬ 
ment  uses.  The  Navy  (Air)  has  an  excellent,  very  flexible  query 
system.  The  Air  Force  Automated  Maintenance  System  (AMS)  for 
C-5As  is  a  superb  system  but  only  for  C~5As.  The  Navy  data 
system  for  submarines  is  very  comprehensive  and  has  paid  for 
itself  many  times  over;  for  example,  by  providing  engineering- 
quality  data  to  support  the  extension  of  overhaul  periods.  In 
addition,  all  of  the  Services  have  good  systems  which  provide 
excellent  data  during  the  acquisition  process  but  in  many  cases 
the  systems  are  not  imposed  on  the  contractor. 

In  spite  of  these  areas  of  success  in  general  the  current 
institutionalized  data  systems  are  archaic.  The  data  systems 
are  useful  only  to  track  trends,  and  then  only  when  (a)  no 
significant  data  systems  changes  have  occurred  within  the 
trending  period  and  (b)  no  significant  changes  in  operational 
scenarios /mission  profiles  have  occurred  in  the  trending  period. 
Data  system  usage  in  studies  such  as  this  are  fraught  with  prob¬ 
lems  because  of  the  requirement  for  quantitative  backup  for  pro¬ 
posed  cha nges/concept s ,  and  hence  the  requirement  to  slice  the 
data  in  ways  it  is  not  normally  sliced  or  to  make  judgment 
based  on  incremental  differences. 

The  current  military  data  systems  do  not.  provide  data  that 
can  be  used  to  characterize  the  R&M  performance  of  a  given 
technology.  For  example,  if  one  were  to  try  to  evaluate  the 
impact  of  changes  from  currently  fielded  solid-state  equipments 

IV-24 


820/4-24 


to  VHSIC  implementations,  it  rapidly  would  become  apparent  that 
the  data  base  does  not  permit  one  to  obtain  R&M  data  at  the 
device  level,  or  by  device  type. 

Contractors  and  customers  require  engineering-quality  data 
in  order  to  be  able  to  correctly  identify  a  problem  and  evaluate 
candidate  solutions  from  both  cost  and  performance  viewpoints. 
Additionally,  it  is  desirable  to  be  able  to  monitor  performance 
of  an  item  by  serial-number  identity,  so  that  the  effectiveness 
of  changes  under  the  conf igurat ion  control  system  can  be  evalu¬ 
ated.  Under  the  current  maintenance  data  systems,  this  is  not 
possible  since  the  data  system  was  not  designed  to  provide  such 
information. 

Detailed,  accurate  data  collected  during  the  early  opera¬ 
tional  phase  of  a  weapon  system  program  is  critical  to  improv¬ 
ing  ^reliability,  maintainability,  and  readiness.  It  is  unrea¬ 
sonable  to  expect  that  all  field  problems  are,  or  can  be,  found 
and  fixed  prior  to  operational  use  of  the  system.  Diagnostics, 
again,  is  the  toughest  area  to  mature  due  to  the  interactions 
with  all  aspects  of  the  support  structure.  Reliability  is  but 
one  driver  of  diagnostics.  Manpower,  human  factors,  training, 
technical  data,  and  support  equipment  all  interact  with  diagnos¬ 
tics  to  increase  the  magnitude  of  the  find-and-fix  process. 
Unfortunately,  the  impacts  of  many  of  these  elements  cannot  be 
assessed  until  the  early  fielding  phase. 

4 .  Action 

Develop  and  implement  policy  to  ensure  that  funding  and 
procedures  are  in  place  to  get  engineering  quality  data  to 
support  the  planned  maturation  on  specific  programs  which 
include  R&M  growth. 
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EDUCATION 


I.  Conclusion 


Actions  to  enhance  and  expand  R&M  knowledge  and  experience 
of  DoD  and  industry  engineers  and  managers  must  be  taken  to 
achieve  long-term  improvement  for  full-range  weapon  system 
acquisitions. 

2 .  Observations 

The  cases  studied  showed  that  contractors  do  respond  to 
perceived  DoD  priorities.  One  factor  which  contributed  to 
contractor  perception  of  the  importance  that  DoD  placed  on  R&M 
was  the  capability  and  knowledge  of  personnel  the  contractors 
interfaced  with  on  R&M-related  items.  R&M  have  not  always  been 
given  proper  emphasis  by  engineers,  support  personnel,  and 
managers.  Managers  and  engineers  must  understand  what  the 
different  elements  of  an  R&M  program  are,  how  they  are  inter¬ 
related,  and  what  they  contribute  to  R&M  success.  Additionally, 
DoD  engineers  and  management  would  benefit  from  having  access 
to  highly  qualified,  experienced  personnel  who  could  assist 
them  at  critical  times  during  program  development. 

3 .  Findings 

There  are  several  facets  to  the  solution  of  this  problem. 

One  of  these  is  R&M  training.  R&M  training  is  provided  currently 
by  a  number  of  separate  DoD  Service  Schools,  contractors,  and 
educational  institutions,  but  it  is  fragmented  and  limited  in 
scope.  There  is  a  real  need  to  upgrade  R&M  training  throughout 
DoD  and  industry. 

The  need  for  improved  training  methods  results  both  from 
the  fact  that  there  is  little  formal  academic  means  to  obtain 
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the  basics  of  reliability  anti  maintainability  skills  and  that 
many,  if  not  most,  of  the  current  DoD  education  programs  do  not 
provide  adequate  coverage  of  the  basics  necessary  for  a  success¬ 
ful  R&M  program.  Within  the  case  studies,  there  was  an  apparent 
correlation  between  the  assignment  of  experienced  personnel  and 
the  relative  success  of  the  particular  program.  How  this  ex¬ 
perience  was  gained  was  not  examined. 

Another  facet  in  the  solution  to  this  problem  is  the  estab¬ 
lishment  of  a  method  of  providing  highly  qualified,  experienced 
"consultants"  to  the  engineers  and  managers  at  critical  times  in 
the  development  cycle.  Various  attempts  have  been  tried  by  the 
Services,  from  the  review  method  such  as  the  Navy  Pre-Production 
Reliability  Design  Review  ( PRDR )  and  Air  Force  Independent  R&M 
Reviews  to  more  formal  assistance  teams.  When  experience  is 
limited,  efforts  must  be  made  to  share  it  among  programs. 

One  conclusion  is  that  the  content  and  results  of  the  case 
studies  could  be  used  to  materially  enrich  existing  educational 
programs  within  the  DoD.  This  would  not  only  improve  the  skills 
of  the  R&M  and  engineering  practitioners,  but  also  form  a  basis 
for  educating  program  managers  and  acquisition  management  execu¬ 
tives  in  the  ramifications  and  implications  of  the  various 
alternative  structures  for  a  successful  R&M  program. 

a.  Improving  the  R&M  Capability  in  DoD.  The  current  DoD 
work  force  has  not  received  sufficient  training  or  support  in 
R&M.  Under  current  circumstances  it  does  not  appear  likely  that 
this  condition  will  change  in  the  future.  In  fact,  the  problem 
is  likely  to  become  more  serious  as  technology  becomes  more  ad¬ 
vanced  . 

Fundamental  needs  for  improving  the  DoD  R&M  work  force  com¬ 
petence  and  performance  are  divided  into  four  categor i es--devel - 
opment  of  DoD  work  force  capability,  development  of  an  in-house 
advice  and  assistance  capability,  improvement  of  contractor  re¬ 
lations,  and  interface  with  the  academic  community. 
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(1)  DoD  Work  Force  Capability.  There  is  a  critical  need 
to  upgrade  the  competence  of  the  DoD  military  and  civilian  work 
force  in  the  design  aspects  of  R&M.  The  engineering  world  is 
one  of  constant  change.  Therefore,  the  DoD  R&M  training  program 
must  he  dynamic  and  include  development  of  system  R&M  require¬ 
ments;  management  of  the  acquisition  process  to  optimize  system 
effectiveness  and  readiness;  R&M  program  management;  R&M  engi¬ 
neering  management;  design  for  R&M;  production  R&M  assurance; 
and  R&M  testing  and  evaluation. 

(2)  In-House  R&M  Advice  and  Assistance  Capability.  Oper¬ 
ational  reliability  and  maintainability  problems  that  are  not 
solved  at  the  source  surface  occasionally  throughout  the  life- 
cycle.  An  in-house  cadre  of  R&M  engineering  specialists  (a 
quick-reaction  team),  that  can  he  tasked  on  short  notice  to 
provide  advice  and  assistance  or  independent  opinions  on  day- 
to-day  operational  problems,  is  a  possible  solution  worth 
exploring . 

(3)  Government/Contractor  Relations.  The  best  results  are 
obtained  through  the  mutual  respect  of  government/contractor 
personnel  working  in  a  cooperative  non-ad ve rsari a  1  manner.  Like¬ 
wise  within  the  government  environment  similar  cooperation  and 
the  ability  to  assess  R&M  activity  are  important  contributors 

to  improved  R&M. 

(4)  Academic  Relations.  Most  college  and  university  en¬ 
gineering  curricula  concentrate  on  basic  skills  and  disciplined 
knowledge.  Only  a  few  courses  address  R&M  technology.  There 
is  a  need  for  increased  communication  between  the  academic 
community  and  the  R&M  engineers  and  technicians. 
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b .  Current  Status  of  R&M  Training  and  Education  in  DoD. 
There  are  several  education  and  training  sources  from  which  DoD 
R&M  engineers  may  obtain  or  may  have  been  obtaining  job-enhancing 
technical  and  management  skills,  knowledge,  and  abilities. 

(1)  Academia .  Formal  college  and  university  training 
specifically  applicable  to  the  needs  of  the  DoD  R&M  work  force 
is  quite  limited.  However,  some  educational  opportunities  are 
available  to  the  R&M  work  force,  but  the  education  available  is 
generally  introductory  in  scope  and  does  not  provide  the  oppor¬ 
tunity  for  in-depth  education  in  R&M  engineering  techniques. 

(2)  DoD  Technical  and  Professional  Training.  Within  the 
Department  of  Defense,  a  number  of  schools  focus  on  the  techni¬ 
cal  problem  of  acquiring  new  weapon  systems: 

•  Defense  Systems  Management  College  ( DSMC ) .  The  current 
curriculum  of  DSMC  includes  the  20-week  Program  Manager's 
Course,  a  3-week  Executive  Refresher  Course,  and  a  1- 
week  Flag-Rank  Refresher.  These  courses  include  R&M 

and  readiness  issues  in  the  general  course  of  instruc¬ 
tion  as  elements  of  the  major  case  studies  and  class 
exercises.  Guest  lectures  by  noted  authorities  in  the 
field  are  also  utilized.  This  approach  places  the  sub¬ 
jects  into  context  and  allows  the  students  to  grasp  the 
complexities  and  interrelationships  of  the  various 
issues  instead  of  viewing  the  subjects  in  isolation. 

The  current  approach  may  benefit  from  examining  the 
material  that  has  been  gathered  by  the  case  studies  and 
using  this  material  to  update  and  expand  the  content  of 
the  course  case  studies  and  exercises  used  at  DSMC. 

•  U.S.  Army  Management  Engineering  Training  Activity 

( USAMETA ) .  USAMETA  is  a  management  training,  research, 
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and  consulting  organization  within  the  U.S.  Army  Mate¬ 
riel  Development  and  Readiness  Command  (DARCOM)  and 
trains  13,000  DoD  students  per  year  in  short,  concen¬ 
trated  management  and  engineering  courses.  The  current 
curriculum  of  100  courses  includes  eight  which  are  de¬ 
signed  to  satisfy  expressed  training  needs  for  the  R&M 
engineering  community  within  DoD.  Several  other  courses 
contain  R&M  subject  material.  These  courses  are  de¬ 
signed  for  R&M  support  personnel  and  managers  from 
other  functional  areas. 

Army  Logistics  Management  Center  (ALMC).  ALMC  is  a 
DARCOM  school  whose  mission  is  to  conduct  training,  per¬ 
form  research,  formulate  doctrine,  and  provide  informa¬ 
tion  and  consulting  programs  for  logistics  management 
matters.  The  ALMC  curriculum  consists  of  71  courses. 
These  courses  are  designed  for  journeymen  and  managers. 
With  the  exception  of  a  specialized  Army-peculiar 
reliability-centered  maintenance  course,  the  ALMC  cur¬ 
riculum  includes  no  R&M  courses.  However,  many  courses 
include  blocks  of  training  on  R&M.  The  DARCOM  Intern 
Training  Center  (ITC)  located  at  Texarkana,  Texas,  is  a 
component  of  ALMC.  ITC  provides  R&M  training  for  two 
one-year  DARCOM  Intern  Training  Prog r ams— t he  Maintaina¬ 
bility  Engineering  Intern  Program  and  the  Ouality  and 
Reliability  Engineering  Intern  Program.  These  programs 
are  designed  to  assist  graduate  engineers  in  making  the 
transition  into  the  Army  R&M  community. 

Navy  Acquisition  Logistics  Management  School.  The 
school  educates  Navy  military  and  civilian  personnel 
on  the  current  acquisition  and  logistics  policies  and 
procedures.  Each  one-week  class  consists  of  15-40  pro¬ 
gram  management,  fiscal  and  support  personnel.  One 
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session  is  devoted  to  R&M  and  includes  an  overview  of 
this  R& M  study. 

•  Air  Force  Institute  of  Technology  (AFIT),  School  of 
Systems  and  Logistics.  AFIT  conducts  courses  that  are 
designed  to  provide  instruction  in  systems  logistics 
and  management  areas  related  to  military  and  civilian 
duty  assignments.  The  Professional  Continuing  Educa¬ 
tion  ( PCE )  Program  consists  of  approximately  58  courses 
of  relatively  short  duration — 1  to  7  weeks.  Course 
content  generally  emphasizes  the  operational  areas  of 
systems  acquisition  and  logistics  management.  As  a 
part  of  the  above  curriculum,  AFIT  offers  four  R&M 
courses  for  Air  Force  students.  The  courses  address 
reliability,  R&M  research  and  applications,  reliability 
theory,  and  life-cycle  cost  management. 


•  Other  Short  Courses.  Other  means  also  used  by  the 

military  services  for  R&M  training  are  contract  train¬ 
ing  and  utilization  of  in-house  experts.  The  Defense 
Logistics  Agency  (DLA)  and  the  Navy  make  extensive  use 
of  this  approach.  Such  courses  are  usually  intended  to 
be  conducted  for  some  limited  time  period  and/or  spe¬ 
cialized  audiences. 


c.  Actions .  DoD  R&M  training  is  currently  being  provided 
by  a  variety  of  sources,  both  in-house  and  contractor.  However, 
there  is  no  organized  program  to  establish  and  maintain  a  co¬ 
ordinated  R&M  curriculum  for  engineers,  support  personnel,  or 
managers  on  a  DoD-wide  basis.  As  a  result,  there  is  opportunity 
for  nonuniformity  in  training,  overlap  in  course  offerings,  and 
omissions  where  training  may  be  badly  needed.  There  is  a  need 
to  integrate  R&M  training  activities  throughout  DoD. 
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Two  basic  alternatives  could  meet  the  criteria  specified 
above : 

•  Establish  a  new  organization  with  a  mission  to  provide 
R&M  training  and  related  advice  and  assistance  to  the 
DoD  community. 

•  Assign  executive-agency  responsibility  to  an  existing 
organization  for  R&M  training.  The  executive  agent 
could  work  closely  with  DoD,  academia,  and  industry 
training  institutions  to  develop  a  comprehensive  R&M 
training  curriculum. 

In  addition,  consideration  should  be  given  to  reestablishing 
Master's  Degree  Programs  in  Reliability  at  schools  like  the 
Army's  Red  River  and  the  Air  Force's  Master's  Degree  School, 
which  were  the  source  of  valuable,  well-trained  people. 
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OFFICE  OF  THE  UNDER  SECRETARY  OF  DEFENSE 

/VASmNGTON  DC  2030' 


ESEARCH  ANO 
ENGINEERING 


2  April  1982 


TASK  ORDER 

NO.  MDA903  79  C  0018:  T-2-126 

TITLE:  Steps  Toward  Improving  the  Materiel  Readiness 

Posture  of  the  DoD  (Short  Title:  R&M  Study) 

1.  This  task  order  is  for  work  to  be  performed  by  the  Institute 
for  Defense  Analyses  (IDA)  under  Contract  MDA903  79  C  0018  for 
Manpower,  Reserve  Affairs  and  Logistics. 

2 .  PURPOSE: 

To  identify  and  provide  support  for  high-payoff  actions  which 
the  DoD  can  take  to  improve  the  military  system  design,  development 
and  support  process  so  as  to  provide  quantum  improvements  in  R&M 
and  readiness  through  innovative  uses  of  advancing  technology  and 
program  structure.  The  DoD  objective  is  to  enhance  the  peacetime 
availability  of  major  weapons  systems  and  to  enhance  the  ability  to 
make  a  rapid  transition  to  high  wartime  activity  rates,  to  sustain 
such  rates  and  to  do  so  with  the  most  economical  use  of  scarce 
resources  possible. 

3 .  SCOPE: 

To  (1)  identify  high  pay-off  areas  where  the  DoD  could  improve 
current  system  design,  development  program  structure  and  system 
support  policies,  with  the  objective  of  enhancing  peacetime 
availability  of  major  weapons  systems  and  the  potential  to  make  a 
rapid  transition  to  high  wartime  activity  rates,  to  sustain  such 
rates  and  to  do  so  with  the  most  economical  use  of  scarce 
resources  possible,  (2)  assess  the  impact  of  advancing  technology 
on  the  recommended  approaches  and  guidelines,  and  (3)  evaluate  the 
potential  and  recommend  strategies  that  might  result  in  quantum 
increases  in  R&M  or  readiness  through  innovative  uses  of  advancing 
technology. 

The  basic  questions  to  be  addressed  in  the  study  are: 

(1)  What  are  reasonable  expectations  for  raising  system 
reliability  and  maintainability  goals,  making  the  best  possible  use 
of  improved  reliability  management  techniques  which  have  been 
demonstrated  and  of  emerging  maintenance  technologies — diagnostics, 
computer-aided  maintenance  training,  etc.? 
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;  2 )  What  are  the  estimated  utility  and  costs  (in  needed  additional 
resource  expenditures)  of  attaining  these  goals? 

(3)  To  the  degree  such  attainment  is  worthwhile,  how  can  it  best 
be  implemented? 

It  is  desired  that  the  focus  of  the  study  be  a  pragmatic,  in- 
depth  review  of  several  of  the  more  successful  recent  major  systems 
and  sub-systems  developments,  of  developing  technologies  with 
particular  potential  for  improving  maintenance  effectiveness  and  of 
such  recent  studies  which  can  contribute  to  the  integration  and 
interpretation  of  the  data  obtained.  The  emphasis  should  be  placed 
upon  the  elucidation  and  integration  of  the  expert  knowledge  and 
experience  of  the  engineers,  developers,  managers,  testers  and  users 
involved  with  the  complete  acquisition  cycle  of  the  selected  systems 
as  well  as  upon  supporting  analysis.  The  results  are  intended  for 
possible  application,  as  appropriate,  to  new  weapons  systems  and 
sub-systems  now  in  the  planning  or  development  stage. 

4 .  SPECIFIC  TASKS  AND  ADDITIONAL  GUIDANCE : 

a.  A  review  will  be  made  of  recently  acquired  systems  and/or 
sub-systems  with  perceived  above  norm  R&M,  and  developed  using 
practices  representative  of  each  Service,  in  order  to  determine: 

(1)  What  were  the  R&M  objectives  and  how  were  they  arrived 

at? 

(2)  How  were  the  programs  structured  to  meet  the  objectives? 

(3)  How  did  costs,  schedule  and  performance  objectives 
impact  the  R&M  levels  that  were  achieved? 

(4)  The  acquisition,  contractual,  incentives  and  funding 
approaches  used. 

(5)  What  engineering  approaches  were  taken  and  how  was 
technology  applied  to  meet  these  objectives? 

(6)  How  were  the  evolving  systems  tested  and  what  approach 
was  used  to  correct  deficiencies? 

(7)  what  were  the  effects  of  reducing  the  support  tail  or 
otherwise  simplifying  the  support  structure? 

b.  Assess  diagnostics  technologies;  specifically,  include  BIT 
and  ATE  approaches  used  in  systems  with  above  norm  performance. 

Also,  compare  the  original  estimates  of  numbers  and  skills  levels 
of  the  maintainers  required  with  the  actual  numbers  and  skills 
levels  required  for  these  or  other  systems. 
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c.  Assess  the  potential  impact  of  new  and  advancing  technology 
on  the  recommended  approaches  for  R&M  and  diagnostics.  Recommend 
how  best  to  exploit  this  new  technology  in  order  to  achieve  R&M, 
diagnostic,  or  readiness  improvements.  Include  the  recommendation 
of  innovative  support  or  design  concepts  that  would  have  significant 
beneficial  impact  from  the  new  technology. 

d.  Analyze  and  assess  the  pros  and  cons  of  the  approaches 
(particularly  contracting  approaches,  funding,  testing,  R&M 
engineering  practices)  used  and  develop  specific  combinations  of  these 
approaches  or  modifications  of  them  that  can  be  applied  to  various 
weapon  types. 

e.  Integrate  the  results  into  a  form  appropriate  for  presen  :ation 
to  a  nigh  level  joint  Industry/Service  group  whose  objective  will 

be  to  review  and  develop  further  recommendations  that  would  lead 
to  the  development  of  weapon  systems  with  improved  ?.&M.  The 
application  will  be  to  new  weapons  systems  now  in  the  planning 
or  development  stage. 

It  is  expected  that  a  phased  approach  will  be  used.  The  phasing 
is  to  permit  flexibility  in  staffing  as  the  nature  of  the  effort 
changes,  to  permit  meaningful  periodic  review  of  progress  and 
results  and  to  permit  redirection  in  approach  in  respcr.se  to 
interim  lessons  learned.  It  is  further  anticipated  that  extensive 
use  will  be  made  of  the  workshop  approach  to  ensure  combined  depth 
and  breadth  of  review  as  well  as  to  permit  meaningful  involvement 
by  the  ultimate  implementers  of  study  results. 

Phase  1 — Organization  and  Planning. 

This  effort  is  to  develop  the  basic  study  rationale,  organiza¬ 
tion  and  plan  of  action  for  review  and  approval  to  proceed  by  the 
cognizant  office  and  IDA.  Available  data  and  information  will  be 
gathered  and  utilized  to  the  degree  feasible  in  achieving  the 
following  basic  Phase  1  objectives: 

(1)  Compile  and  assess  R&M  f igures-of -mer i t  to  represent  system 
readiness,  reliability,  maintainability  and  support  manpower  needs, 
both  in  peacetime  and  wartime. 

(2)  Develop  and  apply  the  rationale  for  selection  of  systems 
and/or  sub-systems  to  be  studied. 

(3)  Develop  the  plan  for  the  organization,  staffing  and 
implementation  of  the  study.  Specific  attention  should  be  paid 
to  the  need  for  tapping  the  diverse  sources  of  in-depth  knowledge 
which  exist  among  contractors,  and  Service  laboratory,  development, 
test  and  operational  units. 
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(4)  Develop  an  initial  approach  to  the  integration  and  analysis 
of  the  information  developed  and  its  application  to  the  development 
of  improved  approaches  to  better  reliability  and  maintenance. 

Phase  2--Program  Reviews. 

For  each  selected  weapons  system  and/or  sub-system  program  and 
for  technologies  selected,  carry  out  the  planned  study  activities 
to  address  the  issues  identified  in  5  (a) ,  (b) .  Complete  the 
acquisition  of  such  other  data  or  studies  needed  for  Phase  3.  A 
preliminary  report  of  findings  shall  be  made  in  October  1982. 


Phase  3--Analysis  and  Integration. 


Carry  out  specific  tasks  5(c),  (d) ,  analyze  the  pros  and  cons 
of  the  alternative  approaches  devised,  perform  informal  structured 
reviews  and  critiques  with  the  community  of  potential  implementers 
of  study  results.  Prepare  draft  reports  suitable  for  Phase  4. 

Phase  4 — DoD  Review. 

IDA  is  requested  to  support  this  effort  by: 

(1)  developing,  organizing  and  presenting  the  study  results, 
suggestions  for  high-payoff  actions  and  technical  issues  to  be 
addressed; 


(2)  provide  technical  support  to  Review  Group  activities; 


(3)  summarize  the  proceedings  of  the  meeting  and  prepare  draft 
formal  recommendations  for  Review  Group  review  and  approval. 

Phase  5 — Follow-on  Studv. 


As  agreed  by  the  cognizant  office  and  IDA,  and  within  funding 
limitations  then  existing,  carry  out  recommendations  of  the  DoD 
Review  Group  for  additional  special  study  activities. 

5 .  SCHEDULE: 

This  is  planned  to  be  a  multi-year  study.  During  FY  1982,  Phase 
1  is  to  be  completed  and  Phase  2  undertaken.  The  Phase  1  results  are 
to  be  completed  and  briefed  to  the  cognizant  office  within  90  days 
of  initial  staffing  of  this  effort.  Interim  Phase  2  results, 
consisting  of  initial  review  and  analysis  of  selected  programs  and  a 
preliminary  technology  assessment,  shall  be  completed  and  briefed  to 
the  cognizant  office  by  October  15,  1982  and  a  draft  report  submitted 
30  days  thereafter.  Remaining  schedule  milestones  will  be  as  approved 
jointly  by  the  cognizant  office  and  IDA  following  review  of  Phase  1 
results. 
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6 .  COORDINATION : 

Throughout  the  study  effort,  coordination  will  be  maintained, 
through  the  cognizant  office,  with  the  offices  of  Acquisition 
Management,  Assessment,  and  Tactical  Warfare  Programs.  The 
cognizant  office  will  provide  guidance  to  the  study  group  as  to  the 
nature  and  form  of  results  judged  to  have  maximum  potential  value. 

7 .  FUNDING: 

$400,000  is  authorized  to  be  expended  in  FY  1982.  $400,000  is 

planned  for  FY  1983.  Complete  resource  planning  is  contingent 
upon  review  and  approval  of  Phase  1  results. 

8 .  TECHNICAL  COGNIZANCE: 

The  cognizant  office  for  this  study  is  Special  Assistant  for 
Weapon  Support  Improvement  (MRA&L) . 

9.  SPECIFIC  ADMINISTRATIVE  INSTRUCTIONS: 

a.  If  at  any  time  during  the  course  of  this  task,  IDA  identifies 
the  need  for  changes  in  this  task,  such  as  additional  resources, 
schedule  modif ication,  changes  to  emphasis  of  effort  or  scope,  etc., 
as  set  forth  in  the  above  paragraphs,  a  report,  with  appropriate 
recommendations,  will  be  submitted  in  accordance  with  the  terms  of 
the  IDA/WSEG  Memorandum  of  Understanding  of  12  March  1975  (and  its 
successor)  as  applicable  to  the  Executive  Secretary,  DOD-IDA 
Management  Office,  OUSDFE,  with- a  copy  to  the  sponsor  or  his  project 
officer,  as  appropriate.  Changes  in  this  task  will  be  made  only 
with  the  approval  of  appropriate  cognizant  DoD  officials. 

b.  This  task  will  be  conducted  under  Industrial  Security 
Procedures  in  the  IDA  area.  If  certain  portions  of  the  task  require 
the  use  of  sensitive  information  which  must  be  controlled  under 
military  security,  the  DOD-IDA  Management  Office  will  provide 
supervised  working  areas  in  which  work  will  be  performed  under 
military  secur i ty  con tro 1 . 

c.  A  "need  to  know”  is  hereby  established  in  connection  with 
this  task  and  access  to  classified  documents  and  publications  and 
security  clearances  necessary  to  complete  the  task  will  be  obtained 
through  the  DOD-IDA  Management  Office  unless  otherwise  instructed. 
Report  distribution  and  control  will  be  determined  by  the  sponsor. 
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APPENDIX  R 

STUDY  PROCESS  OVERVIEW 


A.  INTRODUCTION 

This  volume  integrates  the  extensive  study  efforts  of  a 
large-scale  technology  analysis  and  case  study  analysis  activity 
and  provides  findings  and  recommendations  with  associated  imple¬ 
mentation  plans  for  improving  weapon  system  readiness  through 
innovative  program  structuring  and  integration  of  new  and  advanc¬ 
ing  technology. 

The  study  was  done  for  OASD  (MRA&L)  and  USDR&E,  with  Mr. 
Russell  Shorey  (MRA&L)  serving  as  the  Department  of  Defense  point 
of  contact . 

The  results  presented  in  this  and  other  volumes  are  those 
of  one  of  the  largest  study  efforts  ever  focused  on  readiness 
through  R&M .  The  study  could  only  have  been  done  with  the  extra¬ 
ordinary  leadership  and  support  of  personnel  if  the  Office  of  the 
Secretary  of  Defense,  the  military  services,  government,  industry, 
and  academia. 


B.  BACKGROUND 

As  a  result  of  the  1981  Defense  Science  Board  Summer  Study 
on  Operational  Readiness,  Task  Order  T-2-126  was  generated  to 
look  at  potential  steps  toward  improving  the  Material  Readiness 
Posture  of  DoD  (short  title:  R&M  Study).  This  task  order  was 
structured  to  address  the  improvement  of  R&M  and  readiness 
through  innovative  program  structuring  and  applications  of  new 
and  advancing  technology.  This  Volume  integrates  analysis  rela¬ 
tive  to  Volume  III,  program  structuring  aspects,  and  Volume  IV, 
new  and  advancing  technology  aspects  of  readiness. 
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C.  OBJECTIVE 

The  study  objective  is  defined  in  Task  Order  T-2-126 
as  follows: 

"Identify  and  provide  support  for  high  pay-off 
actions  which  the  DoD  can  take  to  improve  the 
military  system  design,  development  and  support 
process  so  as  to  provide  quantum  improvements 
in  R&M  and  readiness  through  innovative  uses  of 
advancing  technology  and  program  structure." 

D.  SCOPE 


The  scope  of  this  study,  as  defined  by  the  task  order,  is 

"To  (1)  identify  high  pay-off  areas  where  the  DoD 
could  improve  current  system  design,  development 
program  structure  and  system  support  policies, 
with  the  objective  of  enhancing  peacetime  avail¬ 
ability  of  major  weapons  systems  and  the  potential 
to  make  a  rapid  transition  to  high  wartime  activity 
rates,  to  sustain  such  rates  and  to  do  so  with  the 
most  economical  use  of  scarce  resources  possible, 

(2)  assess  the  impact  of  advancing  technology  on  the 
recommended  approaches  and  guidelines,  and  (3)  evalu¬ 
ate  the  potential  and  recommend  strategies  that  might 
result  in  quantum  increases  in  R&M  or  readiness 
through  innovative  uses  of  advancing  technology." 
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E. 


APPROACH 


The  objective  of  the  overall  study  was  to  produce  meaningful 
and  implementable  recommendations,  substantiated  by  quantitative 
data  and  implementation  plans. 

1 .  Overall  Approach 

To  accomplish  the  overall  objective,  emphasis  was  placed  on 
the  elucidation  and  integration  of  the  expert  knowledge  and 
experience  of  engineers,  developers,  managers,  testers,  and  users 
involved  with  the  complete  acquisition  cycle  of  weapon  system 
programs,  as  well  as  on  supporting  analyses.  A  search  for  a 
study  director  was  conducted  through  major  industrial  companies, 
a  director  was  selected,  and  the  following  general  plan  was 
adopted : 

General  Study  Plan  Results  In  Documents 

•  Present  new  concepts  to  DoD  with  Vol .  I 

implementation  plan  and  recommenda¬ 
tions  for  application. 

•  Analyze  and  integrate  review  results.  Vol.  II 

•  Develop,  coordinate  and  refine  new  Vol.  II 

concepts . 

•  Select,  analyze,  and  review  existing  Vol.  Ill 

successful  programs. 

•  Analyze  and  review  related  new  and  Vol.  IV 

advanced  technologies. 

The  approach  to  implementing  the  plan  was  based  on  an  execu¬ 
tive  council  core  group  for  organization,  analysis,  integration, 
and  continuity.  Extensive  use  was  made  of  working  groups,  with 
heavy  military  and  industry  involvement  and  participation,  and 
coordination  and  refinement  through  joint  industry/Service  analyses 
and  review.  The  overall  study  organization  is  shown  in  Fig.  B-l. 


1  3/4- 


Phase  1  was 


The  study  was  divided  into  five  phases, 
focused  on  the  organization  and  planning  aspects  of  the  study. 
Phase  2  on  the  technology  and  case  study  reviews,  Phase  3  on 
the  analysis  and  integration  of  data,  Phase  4  on  DoD  review, 
and  Phase  5  on  areas  for  consideration  in  follow-on  activity. 
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Executive  Council 

An  executive  council  core  group  was  established  in  July, 
1982.  Members  consist  of: 


INDUSTRY  PARTICIPANTS 

Booton,  William  C. 
Danielson,  Oliver  F. 
Edwards,  James  P. 
England,  Gordon  R. 
French,  Carl  H. 

Giles,  Jack  A. 

Karr,  Charles  H. 

Kern,  George  A. 

Krantz,  Frank  M. 
Lavery,  Jack  V. 

Lyon,  Dr.  Hylan  R.,  Jr 

MILITARY  PARTICIPANTS 

Burnette,  Howard  E. 
Clouse,  LC DR  Paul 

DeLauche,  Ma j .  John  S. 
Duff,  James  R 

Griffin,  LTC  Larry  D. 
Herge nroede r ,  Maj.  Bob 
LaSala,  Kenneth  P. 
Light,  Harry 

Lowell,  Capt  James  R. 
Neff,  Robert 
Nordstrom,  Arthur  H. 


General  Dynamics 
McDonnell  Douglas 
Gould,  Inc./DED  - 
General  Dynamics 
Boeing  Aerospace  Co. 

Texas  Instruments,  Inc. 
Westinghouse  Electric  Corp. 
Hughes  Aircraft  Co. 
Westinghouse  Electric  Corp. 
Martin  Marietta  Corp. 

Texas  Instruments,  Inc. 

UR  Army/Logistics  Center 
Office  of  Chief  of  Naval 
Ope  rations 
HO  USAF/RDPT 
Naval  Operational  Test 
and  Evaluation  Force 
HO  AFALD/PTR 
HO  USAF/RDCS 

HO  Naval  Material  Command 
US  Army  Materiel  Development 
&  Readiness  Command 
HO  A FT EC/ LG L 
HO  AFSC/ALK 

US  Army  Materiel  Development 
&  Readiness  Command 
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Pa  ige  ,  Ma  j  Alan 
Urban,  Louis,  J. 

Westcott,  Edmund  J. 

OSD  SPONSORS 

Burchfield,  Del 
Contos,  Dr.  George  A. 

DeLauer,  Dr.  Richard 
Gibson,  Lt  Col  Paul  S. 
Gilleece,  Mary  Ann 
Greene,  Kurt 
Korb,  Dr.  Lawrence  J. 

Larimer,  Col  Walker  A. 

Long,  William 
Meth,  Martin  A. 

Mittino,  John  A. 

Shorey,  Russell  R, 

Stinson,  Dr.  Richard  A. 
Webster,  Dr.  Richard  D. 

IDA  PARTICIPANTS 

Goree,  Paul  F. 

Rivoire,  John  R. 

PART-TIME  CONSULTANTS 
Gates,  Howard  P. 

Goldstein,  Siegfried 

Gunkel,  Richard  A. 

Kunznick,  Gene  A. 

Musson  ,  Thomas  A. 

One-  or  two-week  meetings  were 
duration  of  the  study. 


HO  AFSC/ALK 
ASD-AFALD/AX 
HO  AFSC/CCK 


OUSD  (  R&  E  ) 

OASD( MRA&L ) 

USD ( R&E) 

OASD( MRA&L ) 
OUSD( R&E) 

OUSD( R&EJ/DMSSO 
ASD( MRA&  L ) 

OUSD ( R&  E ) /DMSSO 
OUSD(R&E) 

OASD( MRA&L ) 
OUSD( R&E) 

OASD ( MRA&L ) 

OUSD (  R&F.) 

OASD (MRA&L) 


IDA  R&M  Study  Deputy  Director 
IDA  R&M  Study  Director 


IDA 

Consultant 

( Independent 

) 

IDA 

Consu ltant 

( Siegfried 

Enterpr i ses 

,  Inc . 

IDA 

Consu ltant 

( Independent 

) 

IDA 

Consultant 

( Independe  nt 

) 

IDA 

Consultant 

( Eva luat ion 

Resear 

Corporat i 

on  ) 

held 

monthly  at 

IDA  for  the 
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3 .  Case  Study  Approach 

The  basic  case  study  approach  was  to  build  a  foundation 
for  analysis  and  to  analyze  the  front-end  process  of  program 
stn_u  iring  for  ways  to  attain  R&M  ,  mature  it,  and  improve  it. 
Concurrency  and  resource  implications  were  considered.  Tools 
to  be  used  to  accomplish  this  were  existing  case  study  reports, 
new  case  studies  conducted  specifically  to  document  quantitative 
data  for  cross-program  analysis,  and  documents,  presentations, 
and  other  available  literature.  In  addition,  focused  studies 
for  specific  technology  implications  were  conducted  by 
individual  technology  working  groups  and  documented  in  their 
respective  reports.  To  accomplish  the  new  case  studies,  the 
organization  shown  in  Fig.  B-2  was  established. 

In  some  areas  where  program  documentation  and  records  did 
not  exist,  the  actual  experience  and  judgment  of  those  involved 
in  the  programs  were  captured  in  the  case  studies.  Likewise,  in 
the  analysis  process,  the  broad  base  of  experience  and  judgment 
of  the  military/industry  executive  council  members  and  other 
participants  was  vital  to  understanding  and  analyzing  areas 
where  specific  detailed  data  was  lacking. 

4 .  Case  Study  Participants 

Without  the  detailed  efforts,  energies,  patience,  and  candid 
ness  of  those  intimately  involved  in  the  programs  studied,  this 
case  study  effort  would  not  have  been  possible  within  the  time 
and  resources  available. 

Participants  making  major  contributions  to  this  massive 
effort  are  listed  on  the  following  pages. 

In  addition  to  the  listed  participants,  candid  comments  and 
inputs  were  received  from  personnel  from  many  other  programs,  in¬ 
cluding  generals,  admirals,  and  Senior  Executive  Service  personne 
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CASE  STUDY  CASE  STUDIES 


Case  Study  Participants: 

Bailey,  E.W. 

Boiles,  J.H. 

Booton,  Bill 
Brooks,  C.R. 

Butler,  Norman 
Cutchis,  P. 

Danielson,  O.F. 
Dobyns,  Dick 
Eike renkoetter ,  J. 
Fahey,  J.R. 

Farrell,  C.F. 

Fisher,  G. 

Galanti,  Carl 
Gebhardt,  C.C. 

Gibson,  LTC  P.S. 
Goldstein ,  S. 

Goree,  Paul  F. 
Griffin,  LTC  Larry  D. 
Gunkel,  Dick 
Hatfield,  Phil 
Job,  M . A . 

Johnson,  Marvin 
Kamrass,  Murray 
Kennedy,  P.E. 

Kern,  G.A. 

Koon ,  K.F. 

Kunznick,  G.A. 
Lanctot,  R. 

Lawdel,  W. 

Makowsky,  Larry  C. 
McAfee,  Naomi 


McDonnell  Douglas 
McDonnell  Douglas 
General  Dynamics 
Army 

General  Dynamics 
IDA 

McDonnell  Douglas 
West i nghouse 
McDonnell  Douglas 
McDonnell  Douglas 
Hughes  Aircraft  Co. 
McDonnell  Douglas 
AVRADA 

Hughes  Aircraft  Co. 

OSD/MRA&  L 

IDA  Consultant 

IDA  (Case  Study  Director) 

HO  AFALD/PTR 

I  DA  Consultant 

West i nghouse 

Hughes  Aircraft  Co. 

General  Dynamics 

IDA 

Hughes  Aircraft  Co. 

Hughes  Aircraft  Co. 
General  Electric  Co. 

IDA  Consultant 
Hughes  Aircraft  Co. 
McDonnell  Douglas 
DARCOM 

Wes  t i nghou  se 
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Case  Study  Participants,  cont'd: 


McIntyre,  Marlene 
Miller,  R.M. 

Musson,  Tom 
Nelson,  F.B. 

Os  if  chin,  Edward 
Pace,  W.E. 

Parham,  David 
Perkins,  C.P. 
Przedpelski,  Z.J. 
Pyle,  Roy 
Ouinn,  John  C. 
Rakeman,  J. 

Rogger,  W.R. 
Russell,  Capt.  Rob 
Saari,  A.E. 

Selling,  A.  L. 
Slinkard,  J. 
Stevens,  R.R. 
Summers,  Bill 
Tod,  E. 

Venezia,  T.E. 

Wei lborn ,  J . M . 
Widenhouse,  Carroll 


DARCOM 

Hughes  Aircraft  Co. 
IDA  Consultant 
Hughes  Aircraft  Co. 
Singer  Kearfott 
McDonnell  Douglas 
General  Dynamics 
Hughes  Aircraft  Co. 
General  Electric  Co 
Wes  t i nghouse 
ERADCOM 

Hughes  Aircraft  Co. 
McDonnell  Douglas 
ASD/YPEZ 

Hughes  Aircraft  Co. 
General  Electric  Co 
McDonnell  Douglas 
McDonnell  Douglas 
General  Dynamics 
McDonnell  Douglas 
Hughes  Aircraft  Co. 
General  Electric  Co 
HO  AFALD/PTR 
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5 .  Technology  Study  Approach 

The  basic  technology  study  approach  was  to  build  a  founda¬ 
tion  for  analysis  and  to  analyze  areas  of  technology  to  surface: 
technology  available  today  which  might  be  applied  more  broadly; 
technology  which  requires  demonstration  to  finalize  and  reduce 
risk;  and  technology  which  requires  action  today  to  provide 
reliable  and  maintainable  systems  in  the  future.  Program 
structuring  implications  were  also  considered.  Tools  used  to 
accomplish  this  were  existing  documents,  reports,  and  study 
efforts  such  as  the  Militarily  Critical  Technologies  List.  To 
accomplish  the  technology  studies,  sixteen  working  groups  were 
formed,  and  the  organization  shown  in  Fig.  R-3  was  established. 
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6. 


studied,  this  technology  study  effort  would  not  have  been 
possible  within  the  time  and  resources  available. 

Participants  making  major  contributions  to  this  massive 
effort  are  listed  on  the  following  pages. 


In  addition  to  the  listed  participants,  candid  comments 
and  inputs  were  received  from  personnel  from  many  programs, 
including  generals,  admirals,  and  Senior  Executive  Service  per¬ 


sonnel  . 


R-16 


r 


Technology  Study  Participants: 

Ahouse ,  Dr .  D. 

Alloway,  Francis  E. 
Argento,  Dr.  Joseph  M. 
Asman,  Peter 
Augl,  Joseph  A. 

Bareford,  Robert 
Behnen,  George  M. 

Bird,  Joe 
Blackbrn,  Eugene 
Bosworth,  Joe 
Breland,  Maj.  John 
Broz,  Alan 
Ciccio,  Joseph 
Clark,  Richard  J. 

Conroy,  John  T. 

Cooper,  Dr.  Thomas 
Coppola,  Tony 
Crossman,  Dr.  Frank 
Davis,  Walter 
Dexter,  H.  Bensen 
Dorgan,  CMS  John  F. 

Finn,  Paul 
Foltz,  John 
Foutz,  Gerrold 
Freedman,  Dr.  J. 

Gardner,  Dr.  James 
Garrett,  Ray 
Gause,  Lee  W. 

Giles,  Jack 
Giordano,  Paul 
Glista,  Andy 


AVCO 

General  Dynamics 
Army  DRDAR-OAS 
NAVBEA 

Naval  Surface  Weapons  Ctr 
Northrop  Corp. 

Army  DADAV-0 

Martin  Marietta  Bosworth, 
RADC 

RB  Robot  Corp. 

Air  Force  HO  AFSC/DL 

AMMRC 

Raytheon 

General  Electric 
Army  DADAV-0 
Air  Force  AFWAL/ML 
RADC 

Lockheed 

Boeing 

NASA/Langley  Research  Ctr 
Air  Force  SA-ALC/MMEI 
Sikorsky  A/C 

Naval  Air  Systems  Cmmand 

FOUTZ 

MIT/LL 

Honeywel 1 

McDonnell  Aircraft  Co. 
Naval  Air  Development  Ctr 
Texas  Instruments 
GIORDANO 

Naval  Air  Systems  Comm;  d 


Technology  Study  Pa rt ic i pa n t s ,  cont'd: 


Green,  Dr.  Robert  E. 
Halpin,  Bernard 
Haskins,  James  F. 

Hatch,  Harold  P. 
Hebenstreit,  Wolf 
Herr,  J.C. 

Hess,  Andy 
Hornbeck,  Don 
Horton,  Ray 
Howard,  Paul 
Hudgins,  Wayne 
Katz,  Rod 

Kedzior,  Chester  T. 
Klapper,  E. 

Konsowski,  Stephen  G. 
Labor,  James 
Lacedonia,  Daniel 
Las ala,  Ken 
Lee,  Dick 
Lewis,  W.H. 

Light  ,  Harry  L . 

Linder,  Steve 
Lowell,  Capt.  Jim 
Lyon,  Hylan  H. 

Mayer,  Dr.  George 
Maynard,  Egbert  (Sonny) 
Mayo,  Bruce 
McGillivary,  Duncan 
McKee,  Dean 
Meade ,  L . E. 

Merriman,  Steve 
Metcalf,  Doug 


Johns  Hopkins  University 
Army  DRXMR/OC 
General  Dynamics 
Army  DRXMR-S 
Boe  i  ng 

General  Dynamics 

NASC 

EG&  E 

Boe i ng 

TEDECO 

AVARDCOM 

Naval  Avionics  Center 
Army  DRSTA-QAT 
Hughes 

West i nghouse 
Northrop  Corp. 

Hamilton  Standard 

URN 

USN 

Lockheed 
Army  HO  DARCOM 
NASC 
USA  F 

Texas  Instruments 
ARO 

OSDR&E 

Sperry 

URN 

NOSC 

Lockheed -Georg i a 

NADC 

Essex 
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Technology  Study  Participants 

Meth,  Martin 
Mil le  r  ,  Dr .  J . 

Mitchel 1 ,  Tom 
Muckier,  Dr.  Fred 
Mullineaux,  James  L. 
Mulvi 1 le ,  D.R. 

Nawrocki ,  Dr.  Leon 
Neumann,  George 
Nicholas,  Jack  R. 

Norton,  Bryan  A. 

Nunn,  Mel 

O'Neill,  Dr .  Harry 
Orlansky,  Dr.  Jesse 
Osborn,  Jack 
Pearson,  Dr.  J. 

Phifer,  Maj.  Lonnie  D. 
Pratt,  Isaac 
Prokop,  Jon 
Reifsnider,  Kenneth 
Renton,  James  C. 

Rice,  Ray  W. 

Robbins,  Maurice 
Roderick,  Dr.  George  L. 
Rosen,  Ken 
Sandow,  Forrest 
Sendeckyj,  George 
Shapery,  Richard  A. 
Shapiro,  Homer 
Shaw,  William 
Sicilia,  Dr.  Thomas 
Singleton,  William 
Soderquist,  Joseph 


cont 1 d  : 

OASD 

TRW 

Research  Triangle 
Canyon 

Air  Force  AFWAL/FIBC 
Naval  Air  Systems  Command 
ARI 

Giordano 

Naval  Sea  Systems  Command 
Ratelle  Columbus  Labs 
Naval  Ocean  Systems  Ctr. 
ARI 
IDA 

Structural  Dynamics 
UTRC 

Air  Forec  SA-ALC/MMF1I 
ERADCOM 

Texas  Instruments 
Virginia  Polytechnic  Inst 
Vought  Corp. 

Naval  Research  Lab 
IBM 

Army  A VR A DCOM 
Sikorsky 

Air  Force  AFWAL/FIBAC 
Air  Force  AFWAL/F1BF. 

Texas  A&M  University 

Hughes 

MPS 

DSAD 

Federal  Aviation  Adm . 
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Technology  Study  Participants,  cont'ri: 


Spitzer,  Hermann,  J . 

Spr  i  nge  r  ,  (Torije 
Squires,  Steve 
Starnes,  James  H. 
Stellahotte,  Michael  L. 
Stone,  Robert 
Tsa  i  ,  St  epho  n  W . 

Unyer,  Robert 
Urban,  Richard 
Vest.ewig,  Or.  Richard 
Watson,  Paul 
Weddle,  Peter 
Wilkins,  Dick 
V) i  1  1  i.  ams  ,  Mike 
Wolpin,  M. 

Wright,  John  C. 
'Zimmerman,  Dan 


M FRA DCOM 

University  of  Michigan 
OUSDRjvP 

NASA/La nq ley  Research  Ctr. 
Naval  Air  Development  Cmd . 
Lockhoed-Co 1 i forn  ia 
Air  Force  A F WA L/M LB M 
A  FT 

General  Electric 
Hon  e y we  1  1 
Hughes 
DRC 

General  Dynamics-Ft.  Worth 

Bel  1 

General  Electric 
I  SUM 


7  .  Add  i  t  ir  na  1  Pa  r  t  ic  i  pa  t  ior, 

The  military  services,  universities,  and  over  100  companies 
provided  support  for  the  study.  Over  300  meetings  were  held 
encompassing  technology  working  groups,  case  study  working  groups, 
and  conferences  wit!?  industrial  groups,  senior  military  officers, 
and  government  and  industry  executive  personnel. 
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APPENDIX  C 


DRAFT  ARMY  ACTION  PLAN 


A.  PURPOSE 

This  plan  defines  actions  and  assigns  organizational  respon¬ 
sibility  for  implementing  the  high-payoff  actions  identified 
by  the  OSD  Reliability  and  Maintainability  (R&M)  Study  to  achieve 
quantum  improvements  in  performance  and  readiness  of  future  and 
fielded  Army  systems  and  equipment.  This  plan,  when  approved, 
will  be  incorporated  into  the  thrusts  for  DARCOM  Directions  (D^). 

B.  OBJECTIVES 

The  objectives  are  to  achieve  a  quantum  improvement  in  per¬ 
formance  to  provide  the  capability  to  conduct  dispersed  opera 
tions  for  long  periods  of  time  with  minimal  maintenance  (AIRLAND 
2000)  and  to  achieve  this  performance  at  reduced  acquisition  and 
support  costs. 

C.  HIGH-PAYOFF  ACTIONS 

1 .  Structure  the  Technology  Base  to  Provide  Mature  Technology 
for  Future  and  Fielded  Systems  ( DRCLD  Lead). 

Technical  analyses  will  be  conducted  by  the  appropriate  lab¬ 
oratory  to  determine  the  underlying  causes  of  failure.  Technology 
developments  will  be  identified,  road  maps  (funding  and  schedule) 
developed,  prioritized,  and  target  systems  for  demonstrations  will 
be  identified.  These  technology  programs  will  be  presented  as  a 
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part  of  the  command's  program  presented  annually  at  the  RDTf»F 
Review  and  included  in  the  yearly  DARCOM  Science  and  Technol  <>gy 
Long  Range  Plan  beginning  FY  1985.  (  D^  Thrust:  #4  Long  Range 

Research  and  Acquisition  Plan.) 

2 .  Computer-Aided  Design  (CAD)  and  Computer-Aided  Manufacturing 
(CAM)  Reliability  and  Maintainability  ( R& M )  Modules  ( DRCMT 
Lead  )  . 

A  CAD  system  will  he  developed  and  implemented  that  will 
assure  the  consideration  of  R&M  as  an  ongoing  process  in  the  de¬ 
sign  phase.  A  CAM  system  will  be  developed  and  integrated  with 
the  CAM  system  to  assure  that  R&M  design  features  are  retained 
in  the  manufacturing  process. 

3 .  Improve  Information  for  Performance  Improvement/Cost  Reduc¬ 
tion  Projects  ( DRCSM  Lead). 

Information  to  guide  technology  base  development,  new  sys¬ 
tems  development  and  product  improvement  of  materiel  will  be 
collected/  assembled  and  stored  in  a  single  DARCOM  data  base, 

The  Deficiency  Reporting  System  ( DRS ) .  The  DRS  will  contain 
data  from  all  appropriate  sources  such  as  the  Sample  Data  Col¬ 
lection,  Equipment  Improvement  Recommendation  Program,  Logistics 
Assistance  Program,  screening  of  support  items  consumed,  and 
field  liaison,  post  fielding,  or  fielded  systems  visits/reviews. 
The  principal  performance  indicator  (benefit)  from  this  data 
base  is  as  follows:  the  percentage  of  deficiency  reports  re¬ 
sulting  in  engineering  changes  having  performance  inprowenent/ 
cost  reduction  as  their  objective.  This  system  will  be  opera¬ 
tional  by  first  quarter  FY  1985.  ( D^  Thrust:  #9  Customer 

Support . ) 
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Structure  Acquisition  Programs  to  Optimize  Performance  ( DRCOA 


Lead;  DRCDE  Support). 

A  structure  will  be  developed  and  implemented  in  DARCOM 
programs  which  will  provide  for  front-end  planning  and  activi¬ 
ties  for  elements  of  RAM  design,  RAM  growth  and  environmental 
stress  screening.  Current  procedures  will  be  reviewed,  regula¬ 
tions  changed  and  interim  policy  provided,  training  conducted, 
and  applications  to  current  programs  scheduled.  (D2  Thrust; 

#21  Product  Assurance  Improvement.) 

5 .  Work  Force  Improvement  (DRCPT  Lead). 

Training  programs  in  RAM  for  DARCOM  managers  and  engineers 
will  be  improved.  An  operational  concept  and  resources  plan  to 
strengthen  the  RAM  curriculum  will  be  prepared  (D2  Thrust: 
RESHAPE. ) 

C.  FUTURE  ACTIONS. 

Directorates  designated  as  lead  will  develop  and  implement 
detailed  plans  for  the  above  high-payoff  actions.  A  workshop 
will  be  conducted  to  coordinate  activities  and  a  status  briefing 
will  be  presented  to  the  DARCOM  Command  Group.  Where  necessary, 
adjustments  will  be  made  to  the  POM. 
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